-- Logs begin at Mon 2022-06-06 12:14:14 UTC, end at Mon 2022-06-06 13:26:53 UTC. -- Jun 06 12:48:16.790385 dv-cinder-755101-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 06 12:48:16.797646 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 12:48:16 2022] *** Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: nodename: dv-cinder-755101-10-iscsi Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: machine: x86_64 Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: clock source: unix Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: pcre jit disabled Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: detected number of CPU cores: 4 Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: current working directory: / Jun 06 12:48:16.800681 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: detected binary path: /usr/bin/uwsgi-core Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: your processes number limit is 47680 Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: your memory page size is 4096 bytes Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: detected max file descriptor number: 2048 Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: lock engine: pthread robust mutexes Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: thunder lock: enabled Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 06 12:48:16.804281 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 12:48:16.846539 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: Python main interpreter initialized at 0x5571a84c89c0 Jun 06 12:48:16.846539 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: python threads support enabled Jun 06 12:48:16.846539 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: your server socket listen backlog is limited to 100 connections Jun 06 12:48:16.846539 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: your mercy for graceful operations on workers is 90 seconds Jun 06 12:48:16.846912 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 12:48:16.846989 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: *** Operational MODE: preforking *** Jun 06 12:48:16.847247 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: *** uWSGI is running in multiple interpreter mode *** Jun 06 12:48:16.847247 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: spawned uWSGI master process (pid: 80326) Jun 06 12:48:16.847453 dv-cinder-755101-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 06 12:48:16.850479 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: spawned uWSGI worker 1 (pid: 80340, cores: 1) Jun 06 12:48:16.850479 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: spawned uWSGI worker 2 (pid: 80341, cores: 1) Jun 06 12:48:16.850479 dv-cinder-755101-10-iscsi devstack@keystone.service[80326]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 12:48:22.656114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:48:22.656114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: from cryptography.utils import int_from_bytes Jun 06 12:48:22.656917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:48:22.656917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: from cryptography.utils import int_from_bytes Jun 06 12:48:22.706352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:48:22.706545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:48:22.706733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] command line args: [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:48:22.706995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:48:22.707229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ================================================================================ {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:48:22.707749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] admin_token = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.707749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] config_dir = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.707920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.708100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] config_source = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.708277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] debug = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.709862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.709862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.709862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.709862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.709862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_config_append = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_dir = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_file = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.710913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.711160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.711404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.711612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.711792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.712035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.712279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.712514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.712762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.713233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.713233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.713583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.713761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.713932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.714404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.714562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] publish_errors = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.714788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.715015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.715192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.715435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.715690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.715924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] standard_threads = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.716152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.716392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.716566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.716741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] use_journal = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.716914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] use_json = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.717088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] use_stderr = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.717261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] use_syslog = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.717488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.717741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.717976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.718232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.718467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.718712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.718945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.719191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.719424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.719693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.719939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.720184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.720417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.720661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.720893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.721135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.721379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.721611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.721863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.722114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.722355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.722587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.723414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.723841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.724208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.724466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.724702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.724936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.725170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.725407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.725657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.725906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.726137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.726368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.726615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.726860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.727096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.727345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.727596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.727833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.728066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.728295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.728536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.728765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.728994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.729227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.729471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.729700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.729934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.730162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.730395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.730628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.730871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.731100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.731335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.731587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.731822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.732056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.732290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.732519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.732765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.732998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.733234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.733463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.733720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.733954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.734187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.734422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.734656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.734919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.735154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.735400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.735665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.735900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.736134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.736369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.736615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.736850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.737084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.737164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:48:22.737164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: from cryptography.utils import int_from_bytes Jun 06 12:48:22.737727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.737803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:48:22.737803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: from cryptography.utils import int_from_bytes Jun 06 12:48:22.737928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.737928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.738056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.738212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.739104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.739481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.739750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.739993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.740231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.740473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.740708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.740943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.741178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.741409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.741639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.741869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.742102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.742331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.742578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.742813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.743059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.743303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.743580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.743842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.744083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.744319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.external = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.744549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.744843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.745074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.745303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.password = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.745533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] auth.token = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.745769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.746004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.746248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.746477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.746723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.746969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.747199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.747441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.747705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.747954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.748294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.748420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.748667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.748902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.749165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.749418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.749654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.749906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.750187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.750429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.750696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.750936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.751193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.751429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.751687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.751932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.752185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.752407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.752652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.752887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.753137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.753372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.753623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.753858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.754126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.754367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.754614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.754859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.755091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.755323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.757087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.757355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.757627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.757904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.758177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.758429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.758678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.758923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.759185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.759443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.759723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.759988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.760242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.760518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.760762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.761004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.761238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.761480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.761713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.761951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.762196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.762439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.762693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.762929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.763179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.763429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.763689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.763940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.764188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.764425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.764663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.764895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.765132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.765367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.765611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.765849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.766085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.766333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.766580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.766812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.767045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.767295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.767557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.767799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.768035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.768270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.768502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.768741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.769000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.769233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.769481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.769838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.770103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.770343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.770577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.770814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.771049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.771286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.771518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.771787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.772035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.772282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.772529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.772774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.773006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.773252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.773490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.773726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.773961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.774196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.774445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.774692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.774928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.775182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.775412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.775677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.775915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.776151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.776388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.776634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.776876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.777109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.777346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.777586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.777834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.778082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.778319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.778567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.778814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.779050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.779295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.779542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.779789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.780024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] role.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.780273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] role.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.780504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.780752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.780999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.781245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.781492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.781738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.781982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.782226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.782472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.782705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.783222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.783466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.783740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.783985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.784408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.784489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:48:22.784611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:48:22.784701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.784804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] command line args: [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:48:22.784911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.785069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:48:22.785151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.785245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ================================================================================ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:48:22.785854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.786017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] admin_token = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.786097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.786257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] config_dir = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.786338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.786441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.786559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.786791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] config_source = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.786886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.786963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] debug = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.787046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.787166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.787273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.787400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.787488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.787615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.787715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.787857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.787967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.788104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.788221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.788331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.788468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.788550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_config_append = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.788670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.788759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.788836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_dir = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.788910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.788989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.789144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.789225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.789383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.789461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.789603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.789686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.789851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.789932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.790078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.790160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.790254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.790336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.790494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.790584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.790735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.790817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.790964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.791045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.791196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.791286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.791426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.791507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.791679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.791764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.791921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.792013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.792169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.792250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.792406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.792488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.792653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.792882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.792963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.793066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] publish_errors = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.793148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.793294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.793399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.793518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.793657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.connection = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.793747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.793901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.793983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.794135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.794217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.794363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] standard_threads = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.794445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.794587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.794668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.794824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.794907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.794997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.795074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.795170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] use_journal = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.795280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.795358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] use_json = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.795500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] use_stderr = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.795590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.795694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] use_syslog = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.795777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.795919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:48:22.796013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.796968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.797982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:48:22.798069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.798294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.798534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.798764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.799005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.799234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.799475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.799744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.799975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.800224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.800472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.800711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.801028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.801429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.801689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.801936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.802181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.802408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.802641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.802869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.803100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.803342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.803609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.803835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.804061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.804302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.804545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.804779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.805028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.805252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.805482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.805711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.805936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.806161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.806385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.806610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.806841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.807080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.807310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.807547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.807780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.808010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.808239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.808481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.808706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.808937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.809165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.809393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.809622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.809851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.810076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.810318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.810547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.810776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.810999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.811256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.811484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.811732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.811963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.812193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.812453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.812683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.812926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.813165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.813396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.813626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.813867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.814110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.814342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.814575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.814812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.815044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.815274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.815504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.815757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.815987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.816244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.816491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.817406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.817837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.818198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.818561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.818921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.819299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.819602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.819792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.820019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.820252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.820481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.820717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.820949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.821192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.821426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.821683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.821936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.822172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.822399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.external = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.822624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.822919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.823148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.823375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.password = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.823623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] auth.token = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.823859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.824090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.824329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.824556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.824797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.825039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.825264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.825496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.825737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.825980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.826223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.826454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.826689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.826921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.827187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.827439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.827519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.827696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.827781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.827945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.828027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.828225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.828467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.828725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.828961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.829214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.829447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.829680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.829921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.830163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.830389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.830630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.830861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.831109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.831339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.831614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.831850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.832090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.832374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.832619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.832866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.833093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.833323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.835074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.835340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.835627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.835903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.836171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.836419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.836501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.836667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.836908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.837161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.837415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.837669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.837930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.838181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.838455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.838695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.838935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.839167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.839404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.839663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.839900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.840142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.840381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.840630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.840860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.841106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.841353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.841591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.841835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.842080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.842309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.842543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.842772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.843007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.843240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.843481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.843741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.843974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.844220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.844697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.844926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.845172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.845417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.845650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.845884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.846117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.846346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.846583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.846838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.847069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.847313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.847576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.847869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.848105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.848335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.848568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.848800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.849034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.849263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.849508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.849751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.849994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.850237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.850478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.850706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.850950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.851184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.851416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.851679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.851913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.852153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.852397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.852630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.852881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.853108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.853347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.853579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.853812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.854045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.854288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.854524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.854756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.854988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.855225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.855596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.855737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.855972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.856218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.856463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.856697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.856939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.857172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.857406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.857639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] role.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.857883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] role.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.858109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.858354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.858600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.858844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.859087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.859329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.859591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.859837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.860080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.860311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.860554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.860797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.861040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.861282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.861709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.861940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.862186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.862431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.862675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.862917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.863146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.863917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.864179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.864412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.864640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.864834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.864933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.865066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.865150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.865315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.865565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.865807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.866039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.866269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.866494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.866726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.866957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.867202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.867435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.867711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.867956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.868189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.868429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.868662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.868903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.869134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.869367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.869598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.869840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.870082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.870306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.870543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.870832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.871088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.871326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.871589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.871828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.872066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.872296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.872526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.872757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.872988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.873227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.873455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.873693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.873922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.874164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.874393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.874629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.874854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.875089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.875318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:48:22.875486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:48:22.900218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.900447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.900671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.909316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.919341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.928146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.928377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.966177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.968561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:22.968798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.001328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.001328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.036318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.036548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.036929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.037295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.037685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.038048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.045039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.045419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.045780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.046162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.046516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.046866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.061781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.062014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.062245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.062468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.062684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.062894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.063106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.064056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.064436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.064791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.065141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.065487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.065831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.066184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.074917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.075515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.088952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.089940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.090159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80341) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 12:48:23.107317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.107549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 12:48:23.107795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.108003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 12:48:23.108338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.108462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.108548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 12:48:23.108783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.109003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 12:48:23.109103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.109283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.109534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.109634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.109893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.110155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.110413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.121036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.121310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.121572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.121851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.121943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.122212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.122479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.122757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.130176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.131203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.133465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.133741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.134023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.134298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.134509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.134601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.134786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.134908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.135970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.136129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.136224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.136393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.136649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.136923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.137189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.164393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.165270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.165964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.166230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.166883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.167163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.171656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.171931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.172208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.172612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.172890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.173169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.179587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.179863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.180587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.180871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.184361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.184640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.184919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.185197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.185351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.185561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.185744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.186012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.186257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.186361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.186762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.187178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.187609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.188022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.188424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.188936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.205073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.205358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.208375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.208660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.210583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.213270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.214322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.214602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.217044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.217338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.219643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.222357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.223259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.226049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.226897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.227187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.227465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.227770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.228057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.228338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.229701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.229998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.230285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.230570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.230859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.231146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.247397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.247718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.247996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.248256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.250375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.250658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.250927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.251186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.256675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.259782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.259879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.263158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.263247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.263434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.263521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.263807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.264083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.264352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.266513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.266785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.267064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.267344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.267651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.278722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.279003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.279280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.279573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.279851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.280120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.280388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.281782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.282067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.282350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.282631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.283178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.283448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.283745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.298579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.301781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.301972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.305070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.305423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.307006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.308566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.308707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.308976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.309250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.310170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.311831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.312116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.312394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.317032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.319009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.320286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.321897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.322365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.322649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.322930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.323200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.325272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.325558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.325834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.326103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.332918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.333198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.333474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.335817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.336102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.336378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.341440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80341) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.341715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.341989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.342258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.342525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.342798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.343077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.343347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.343648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.343913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.344175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.344378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 12:48:23.344473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.344655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.344738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.344923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80341) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.345005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.345194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.345464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.345731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.346008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.346277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.346549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.346813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.347080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.347342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.347637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.347922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 12:48:23.383429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5571a84c89c0 pid: 80341 (default app) Jun 06 12:48:23.386439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5571a84c89c0 pid: 80340 (default app) Jun 06 12:48:23.386841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefef3-5bc4-4c83-bb5f-193a62d8010b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:23.387134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefef3-5bc4-4c83-bb5f-193a62d8010b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:23.387410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefef3-5bc4-4c83-bb5f-193a62d8010b None None] PATH_INFO: `/v3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:23.391576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon Jun 6 12:48:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:32.457605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:32.458168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:32.458168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:32.462522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:32.467608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:32.468024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:32.468183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:32.538097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: INFO dbcounter [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] Registered counter for database keystone Jun 06 12:48:32.559966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG oslo_db.sqlalchemy.engines [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:48:32.566092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writer thread running {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:48:32.850692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG passlib.handlers.bcrypt [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80341) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 12:48:32.851029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG passlib.handlers.bcrypt [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80341) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 12:48:32.907084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:32.908981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:33.036578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 06 12:48:33.220484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:33.291124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: INFO dbcounter [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] Registered counter for database keystone Jun 06 12:48:33.310643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG oslo_db.sqlalchemy.engines [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:48:33.317550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writer thread running {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:48:33.544934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32206c-53e7-4261-a626-ef74e3b9154f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:33.549165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:33.549829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:33.550647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:33.551100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:33.559485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:33.612468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 12:48:33.613419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd52f5b-7d97-46c1-a9ac-b4ca11b1c1d0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:33.623072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jun 6 12:48:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 12:48:33.630003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:33.644415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581bdb-d3d6-4b89-89a1-0c5230565127 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:33.648939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:33.650066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:33.650358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:33.650638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] PATH_INFO: `/v3/projects/16ba10bd5fa94006bd8ba1520b916555` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:33.652177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=16ba10bd5fa94006bd8ba1520b916555)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:33.703315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING keystone.common.rbac_enforcer.enforcer [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 12:48:33.703695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef1dfc-932d-4e34-af8f-1a0d16595bb2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:33.709523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jun 6 12:48:33 2022] GET /identity/v3/projects/16ba10bd5fa94006bd8ba1520b916555 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:35.894582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec114-d394-48d0-8f8a-0796b01eef11 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:35.895098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec114-d394-48d0-8f8a-0796b01eef11 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:35.895200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bec114-d394-48d0-8f8a-0796b01eef11 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:35.899230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:35.904622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:35.905058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:35.905322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:35.925527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:35.927051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:35.935351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 06 12:48:35.957965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bec114-d394-48d0-8f8a-0796b01eef11 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:35.970076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bec114-d394-48d0-8f8a-0796b01eef11 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:35.974818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:35.975446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:35.975766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:35.976045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:35.983619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:35.985380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63955686-cdcf-4776-96fa-ff6420251542 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:35.994055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jun 6 12:48:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 06 12:48:35.999301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:36.008771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24844e-9b40-4347-8d76-7d0db847773f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:36.013167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:36.014015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:36.014306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:36.014583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:36.016001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:36.017826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68897-3ffc-49ba-9fae-005081da5f2e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:36.020067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jun 6 12:48:35 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:38.302940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c6e3-6859-4b32-9757-a9c9a6a9543c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.303442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c6e3-6859-4b32-9757-a9c9a6a9543c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.303574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c6e3-6859-4b32-9757-a9c9a6a9543c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.304913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:38.310353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.310773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.311040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.328109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:38.329288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:38.350166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078032b9-f768-4fd0-a274-33d5eb837963 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.350456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078032b9-f768-4fd0-a274-33d5eb837963 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.350739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078032b9-f768-4fd0-a274-33d5eb837963 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.352110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:38.357150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.357439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.357720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.397760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG passlib.handlers.bcrypt [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80340) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 12:48:38.398181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG passlib.handlers.bcrypt [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80340) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 12:48:38.410792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:38.434281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.445618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:38.447233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:38.459372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:38.540105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0730f-3ae3-4469-b623-bbca0fe2b0bf None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:38.548362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:38.571580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.574636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:38.575439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.575756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.576036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.590629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:38.602590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:38.603694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:48:38.604542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:48:38.609553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.677190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff7b7-854c-44d2-999e-d6cf413f48fd None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:38.679447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:38.692056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:38.709865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfe72-0ba7-4ba3-8303-1d113fe716f8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:38.716112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:38.717041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.717334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.717724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.744333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:38.744995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.745284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.745564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.746398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:38.746710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:38.748142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:38.761388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:38.766874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.786322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:38.787886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:38.864822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574793d-873b-45ad-9fff-487fc046575f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:38.886559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 12:48:38.892079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.895753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:38.899042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:38.899964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:38.900580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:38.900580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:38.901715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:38.903253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:38.905006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:38.911177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:38.926973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:38.997035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b482d6c-1804-46b9-8bef-85fb9c01df03 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:39.012328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410e44-2ffc-4436-997a-68f9a809b67c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:39.030010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:39.030917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:39.030917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:39.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:39.046183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:39.046966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:39.047287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:39.047547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:39.048734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:39.051022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:39.052739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:39.053348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:39.055049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:39.058318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:48:39.076518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:39.077636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:39.078677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:48:39.078677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:48:39.078677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:48:39.078677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:39.078677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:48:39.084424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:39.141525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:39.143981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:39.163489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf206a-eba2-48f8-9ac1-d51913c39885 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:39.185888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27830f19-8567-4031-8d8b-994f3ba35723 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:39.197254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:39.197913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:39.198241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:39.205040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:39.205040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.domain.id=default, user.id=1492cd2eb7c64ad8959375e22df26ab7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:39.205040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:39.205040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0921d7-bb3f-4118-ac12-1b660b31b3b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:39.207917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Jun 6 12:48:39 2022] GET /identity/v3/role_assignments?user.id=1492cd2eb7c64ad8959375e22df26ab7&scope.domain.id=default&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:39.219647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:39.220340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:39.220633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:39.220913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:39.222321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:39.222637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:39.224384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f504-cc5c-402a-b86e-ea18cf6e1ace None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:39.245173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:41.980418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297d37-ba82-420a-8415-4a99527ab76e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:41.980961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297d37-ba82-420a-8415-4a99527ab76e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:41.980961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b297d37-ba82-420a-8415-4a99527ab76e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:41.982365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:41.988275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea51f0-b635-43a6-a79f-f0706511d49e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:41.989188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea51f0-b635-43a6-a79f-f0706511d49e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:41.989682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea51f0-b635-43a6-a79f-f0706511d49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.014968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-82ea51f0-b635-43a6-a79f-f0706511d49e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:42.016527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-82ea51f0-b635-43a6-a79f-f0706511d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:42.110168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:42.154439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b297d37-ba82-420a-8415-4a99527ab76e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:42.274565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ec75-4824-473b-bfb9-2714c2b8b053 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.275192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ec75-4824-473b-bfb9-2714c2b8b053 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.275719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104ec75-4824-473b-bfb9-2714c2b8b053 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.277297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:42.283731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bf672-b1c5-444e-be9c-81be03ec240b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.284403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bf672-b1c5-444e-be9c-81be03ec240b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.284897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bf672-b1c5-444e-be9c-81be03ec240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.314970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8f6bf672-b1c5-444e-be9c-81be03ec240b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:42.318651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8f6bf672-b1c5-444e-be9c-81be03ec240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:42.348076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b297d37-ba82-420a-8415-4a99527ab76e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:42.404818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:42.414921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:42.415659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.415951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.416229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.417001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:42.418395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94cc86-e3a7-44a3-8d5c-b4933de98cce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:42.434480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:42.436190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148d46-0b99-4bda-8628-5ff0a6719760 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.436715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148d46-0b99-4bda-8628-5ff0a6719760 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.437164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148d46-0b99-4bda-8628-5ff0a6719760 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.438691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 14/26] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:42.444524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.444827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.445117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.470225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:42.472266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:42.544967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:42.545841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:42.655096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d06c-e4d5-4231-997a-7c3bc18f403b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:42.663298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:42.671853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 13/28] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 6 12:48:42 2022] POST /identity/v3/roles => generated 219 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:42.673380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e10ca-c231-4181-aa16-a35cfd808991 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.673676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e10ca-c231-4181-aa16-a35cfd808991 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.674032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e10ca-c231-4181-aa16-a35cfd808991 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.676660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 14/29] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:42.677590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e10ca-c231-4181-aa16-a35cfd808991 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:42.692057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:42.751196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:42.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.752358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.753201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.790874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-778f7485-972f-4298-b906-b57a199561c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:42.801737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:42.802926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 16/30] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:42.803938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.804768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.804768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.832796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:42.833699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e10ca-c231-4181-aa16-a35cfd808991 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:42.834110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:42.885397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:42.886089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:42.886380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:42.886664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:42.887430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:42.888984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:42.935224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:42.936436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:42.980420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 15/32] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 6 12:48:42 2022] POST /identity/v3/roles => generated 225 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:42.981308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.060398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.102611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809654-5e9f-468a-bee7-0d025ed80b7b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.112559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.124880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e113668-366b-4a0a-b6e6-195ae64aefa5 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.146721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.147629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.147853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.148823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.161935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.163452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:48:43.184948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:43.185996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:43.186915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:48:43.186915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:48:43.186915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:48:43.186915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:48:43.186915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:43.193290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.205794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.206825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.207339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.207850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.208834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:43.209330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.210937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.229863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:43.236442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.312134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faf94-d24c-4828-9cc0-acd8768a6bce None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.332230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.354602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.355609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.355896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.357334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:43.357334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.359568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc90c7e-ebdf-4d3e-a714-cf252aae347a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.383036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d7c9-e088-41d6-95e8-a9e9778b05f8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.383860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 17/35] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:43.385283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c0b9-2922-4cf9-bf6d-8cf0fbd834b3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.385585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c0b9-2922-4cf9-bf6d-8cf0fbd834b3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.385876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9c0b9-2922-4cf9-bf6d-8cf0fbd834b3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.387332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:43.389486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9c0b9-2922-4cf9-bf6d-8cf0fbd834b3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.427595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.429124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.430488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.430944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.432989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.435266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcf93-96f2-43d6-bb44-ab9834a95c8a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.437291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 19/37] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:43 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:43.439728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.440600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.441025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.465606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:43.467447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:43.491266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.503488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9c0b9-2922-4cf9-bf6d-8cf0fbd834b3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.540090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.540753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.541038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.541313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.542015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.543469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.545352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 20/38] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:43.546221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.659563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:48:43 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:43.659787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3c73f-aa26-4691-b8b3-732c4b363f64 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.659882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.698751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.701596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.702410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.702696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.703034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.704270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.706437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.708315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 21/40] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:43.714144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:43.746386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:43.800824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb47e-a579-4e09-b52f-7cf97468037b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.828733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c06e2-c1a3-45cf-a16f-49cdac199c88 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:43.839810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.840502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.840790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.841086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.841846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.843291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d07f-8f0b-4fb4-8af4-6ee0887ceadf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.866934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:43.867849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.868135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.868416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] PATH_INFO: `/v3/domains/default/users/1492cd2eb7c64ad8959375e22df26ab7/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.870538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1492cd2eb7c64ad8959375e22df26ab7, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:43.872045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:43.911158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 6 12:48:43 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:43.912447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247471-ea8a-4914-a89a-83a66ed8d5b6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.912748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247471-ea8a-4914-a89a-83a66ed8d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.913029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247471-ea8a-4914-a89a-83a66ed8d5b6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.915748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 21/42] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:43.920419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:43.920757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:43.921049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:43.941011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:43.942638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:44.029434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:44.054180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:44.070130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 22/44] 10.222.0.13 () {58 vars in 1361 bytes} [Mon Jun 6 12:48:43 2022] PUT /identity/v3/domains/default/users/1492cd2eb7c64ad8959375e22df26ab7/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:48:44.075138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:44.180958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023d6b-56ac-4a8e-8889-76fb3e3f6b44 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:44.217843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:44.218664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:44.218950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:44.219227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:44.220520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:44.222729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dcfa7-7ddf-4505-a35b-665ad9d3ef48 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:44.224473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:44.230543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:44.318836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:44.334717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901e94-5d81-4ce8-83d6-5f5627702901 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:44.370154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:44.370833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:44.371124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:44.371409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:44.372173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:44.373831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b38c9-58db-4cde-b42c-8c706f875852 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:44.462864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:48:44 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:46.291675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572e6b-c4be-4fb5-b357-1abf7b7012e1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.292179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572e6b-c4be-4fb5-b357-1abf7b7012e1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.292179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c572e6b-c4be-4fb5-b357-1abf7b7012e1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.293606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:46.298990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.299415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.299706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.316564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:46.318079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:46.384340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:46.408387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572e6b-c4be-4fb5-b357-1abf7b7012e1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:46.494459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:46.510926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c572e6b-c4be-4fb5-b357-1abf7b7012e1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:46.546802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:46.547540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.547840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.548133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.558164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:46.566253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:46.567195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:48:46.568177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:46.573172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:46.637530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:46.673141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786d670-dfc1-4fd7-87ab-89b03ba81892 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:46.707128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:46.708029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.708747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.709031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.709788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:46.710100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:46.711498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e4641-0253-44c0-b4fd-2edc322b0d0c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:46.719899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:46.725192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:46.727602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73a5e-7eae-46da-8a94-dd5d4bd181e8 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.727903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73a5e-7eae-46da-8a94-dd5d4bd181e8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.728182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a73a5e-7eae-46da-8a94-dd5d4bd181e8 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.729610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:46.734358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.734662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.734940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.751383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:46.753113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:46.819998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 27/52] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:46.826876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656269-72e7-4a70-9f0c-9ff89286bd21 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:46.843479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:46.862530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:46.863404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.863724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.864005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.865226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:46.866695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:46.868336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:46 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:46.873596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:46.889503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:46.905036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:46.946836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de318-80d4-445d-9a9f-556e96bbcd0d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:46.975643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9f43-641e-49ea-b00b-bfbffd86220f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:46.979025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:46.979847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:46.980139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:46.980416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:46.981590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:46.983050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:46.984691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 28/54] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:46.990856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:47.009234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:47.010042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:47.010311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:47.010589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:47.011783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:47.013237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:47.014831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:47.020323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:47.089880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df48-231a-43d2-acaa-9f6bd0272f9d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:47.100156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:47.116686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:47.117887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff8d03-6d8b-4979-b0f9-3c32fe62a804 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:47.125028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:47.125697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:47.125988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:47.126271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:47.126980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:47.128827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512da666-272b-4d16-9bfd-c432b65f7233 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:47.151324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:47.152010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:47.152299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:47.152574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:47.153390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.domain.id=default, user.id=1492cd2eb7c64ad8959375e22df26ab7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:47.153701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:47.155170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c80285-51c0-45c4-a274-a98b8119d42c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:47.161913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 28/56] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Jun 6 12:48:47 2022] GET /identity/v3/role_assignments?user.id=1492cd2eb7c64ad8959375e22df26ab7&scope.domain.id=default&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:47.306120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Jun 6 12:48:46 2022] POST /identity/v3/projects => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:48:49.561842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85818-6704-408c-8f3a-bf0c559ef9fe None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:49.562388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85818-6704-408c-8f3a-bf0c559ef9fe None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:49.562388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85818-6704-408c-8f3a-bf0c559ef9fe None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:49.563822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:49.569578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:49.569951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:49.570161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:49.587234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:49.588461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:49.653434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:49.677559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d85818-6704-408c-8f3a-bf0c559ef9fe None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:49.778827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d85818-6704-408c-8f3a-bf0c559ef9fe None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:49.812583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:49.813309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:49.813596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:49.813877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:49.815873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:49.817329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0e0f0-dc50-4991-805e-56ef4898c827 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:49.818910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:49.824312 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:49.921305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fc0b-9b2c-41b5-803e-481754addb8e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:49.930870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:49.954932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:49.955748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:49.956039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:49.956318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:49.957018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:49.958469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c891-e8bf-4c6e-b3be-5c181692a5ec None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:50.061409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:48:49 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:53.430435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3bc43-ece3-45e3-b3a4-3820cfa2661f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.430941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3bc43-ece3-45e3-b3a4-3820cfa2661f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.431017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3bc43-ece3-45e3-b3a4-3820cfa2661f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.432357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:53.437643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de7d2-1e29-431e-82f0-ef66dfe63148 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.438412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de7d2-1e29-431e-82f0-ef66dfe63148 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.438844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083de7d2-1e29-431e-82f0-ef66dfe63148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.469639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-083de7d2-1e29-431e-82f0-ef66dfe63148 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:53.471780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-083de7d2-1e29-431e-82f0-ef66dfe63148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:53.568503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:53.595926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3bc43-ece3-45e3-b3a4-3820cfa2661f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:53.615617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:53.737986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3bc43-ece3-45e3-b3a4-3820cfa2661f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:53.777545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:53.778358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.778640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.778914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.787707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4ec4-8374-4893-9df4-012355e7ef1e None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.788272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4ec4-8374-4893-9df4-012355e7ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.788772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba4ec4-8374-4893-9df4-012355e7ef1e None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.790368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 33/64] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:48:53.795607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324013d6-806e-4c56-a048-4b541dbe93d6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.797129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324013d6-806e-4c56-a048-4b541dbe93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.797824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324013d6-806e-4c56-a048-4b541dbe93d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.805271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:53.814724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:53.815626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:53.816417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:48:53.824182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 32/65] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:53.834292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-324013d6-806e-4c56-a048-4b541dbe93d6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:53.835513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-324013d6-806e-4c56-a048-4b541dbe93d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:53.835759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:53.918158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:53.919816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c10dd-eb0f-4300-88d6-fbac73876899 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.920307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c10dd-eb0f-4300-88d6-fbac73876899 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.920779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c10dd-eb0f-4300-88d6-fbac73876899 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.922248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 35/67] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:53.924010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddeb31-601a-4df1-a0ba-8dc0c5f317b9 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.924517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddeb31-601a-4df1-a0ba-8dc0c5f317b9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.925073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddeb31-601a-4df1-a0ba-8dc0c5f317b9 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.926497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 36/68] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:53.928308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:53.932139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.932435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.932721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.949414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:53.950615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:53.958463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0c3c-146f-41f7-aa47-158716e4a89b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:53.971574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:53.994111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:53.995004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:53.995445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:53.995899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:53.996649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:53.996960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:53.998342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5358bc-9e5f-4e71-b015-641303f88664 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.008986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 33/69] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:48:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.010823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.011264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.011882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.030048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 37/70] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:54.030048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.031083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:54.032575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:54.100575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 34/71] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:54.101559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.135726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808d27-3b46-4f3e-89cd-06fa141b5e27 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.167297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.169927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.170722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.171018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.171302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.182327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-31744f75-c5ef-4d29-a859-d7e7df19eaef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:54.190152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:54.191012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:54.191828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 38/72] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:54.192796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69032bb-8a9f-49ba-aaaf-c2fdb25cdf16 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.193017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69032bb-8a9f-49ba-aaaf-c2fdb25cdf16 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.193316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69032bb-8a9f-49ba-aaaf-c2fdb25cdf16 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.194818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 39/73] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:54.195962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69032bb-8a9f-49ba-aaaf-c2fdb25cdf16 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.205437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7867a-bffa-45a5-ac3a-ef20c9de9d5f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.213599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.240395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.241271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.241557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.241833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.255868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.257272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.263362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 35/74] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.263362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.300370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69032bb-8a9f-49ba-aaaf-c2fdb25cdf16 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.334721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.335554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.335848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.336132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.346516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:54.354609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:54.355709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 40/75] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:54.356744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.366446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddd840-ae6f-4231-8079-ad6d0aea5df0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.390304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.401141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.401936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.402229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.402525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.413869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9b546d09-a5ca-4519-89ba-292aade0ad5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:54.421530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:54.422578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:48:54.423973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 36/76] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:54.424731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.424924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.425250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.435617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.443663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:54.444856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:54.460699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08743b-209b-4178-addd-dfb0e2e87d91 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.495037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.495744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.496040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.496324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.497085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:54.497403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.498819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.510260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 41/77] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.510260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.515308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 37/78] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:54.516190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.610026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0339b7d-de24-49f1-bfaf-03e8ca8d3af8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.615694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8ce76-99f7-4cae-be77-dfc54360937b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.630029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.643196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.643940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.644233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.644515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.648213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.650119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.650836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.651314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.651662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.652607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:54.652959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.654690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.663562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 38/79] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.664382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.712937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.714431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.762216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920599-e6a8-49df-ae15-478b88c2415e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.795328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.796032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.796320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.796600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.797340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:54.797652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.799731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.807609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 39/80] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.808390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.813344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:48:54.814219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.847869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.850059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:54.910891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ef80b-ee6c-4a8d-83a1-5476f1e3db42 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.913595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4153-ce06-4fd1-9f92-673de1a9df65 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:54.945455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.946337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.946629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.946912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.948082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:54.948214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.948877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:54.949168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:54.949450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:54.949604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.950619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:54.951234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 40/82] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.952025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:54.952122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:54.953953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 43/83] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:54.954611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.055692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ec-1517-4655-8728-c38537aa68a3 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.057779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a37fc6-2f5f-4a78-97a6-618fb3b45ac5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.058669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.065702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.091611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.092484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.092769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.093046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.093829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.094228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.094765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.095285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.095744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.096094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.097357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 41/84] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:55.097580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.098107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.099055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.105292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 44/85] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:54 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:55.105292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.202627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838bca3-00b6-4770-8106-b3c49499496b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.204858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d5af-e000-4c15-a3d4-ef4e5bc95a27 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.237423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.237895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.238287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.238540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.238626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.238829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.238924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.239111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.240076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.241581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.243429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 42/86] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:55.243993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.281407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.287847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.308318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.309724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.343267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc8b3-0675-49ce-881f-1c4baf908057 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.376566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.377242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.377535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.377819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.378530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.380010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.413228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 45/87] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:48:55.414076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.482320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.485594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 43/88] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:48:55 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:55.486931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.519596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffdd91-3673-4971-a72a-3dc78e98d50c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.558984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.560061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.560557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.561035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.601605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.605566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e9b-5724-4b13-8692-8d25173ab9e2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.638165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.639866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.643836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.644516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.644811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.645096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.723046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.729822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.731320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.756018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:48:55.756656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.863991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:55.870930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:48:55.872048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.881805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e645e-5d17-45d8-800d-16d9b03677ee None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.931424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:55.932123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:55.932414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:55.932699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:55.934074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=09093413150e4b37924a82390366a138) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:55.934405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:55.936217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:55.946861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 47/91] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:55.947723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:55.987203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f17c4-860b-4bd6-94f4-781dd1c4e8ba None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:55.997901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:56.034724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.036194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.037256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.037723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.039565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.042368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.044385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:56.045344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:56.086484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a683a4a-22b3-4e5c-954a-72aebfd01eeb None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:56.121370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:56.139453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.142619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.143082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.144762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.146817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.150296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.152180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 48/93] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:48:55 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:56.152974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:56.188579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019422-59b9-4a94-896a-85bc85734a26 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:56.257412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.258293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.258580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.258859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] PATH_INFO: `/v3/projects/82ce942051f24419a3122f7e40a47759` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.261238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce942051f24419a3122f7e40a47759)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.262745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.264837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 46/94] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:48:56 2022] GET /identity/v3/projects/82ce942051f24419a3122f7e40a47759 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:56.265437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:56.337200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047df78-07d3-4a1d-871c-473b94b9da5e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:56.340592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:56.381767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.382433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.382725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.383010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.383909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=1492cd2eb7c64ad8959375e22df26ab7) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:56.384234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.385706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.389925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744ab4-1507-455b-8e6d-4c5fec0a23d8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:56.395792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 49/95] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:48:56 2022] GET /identity/v3/role_assignments?user.id=1492cd2eb7c64ad8959375e22df26ab7&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:56.396766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:56.434751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.435436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.435758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.436042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.436905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=09093413150e4b37924a82390366a138) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:56.437225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.438740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057aa4d-ef48-4f6f-8d3d-ac8cef5bd481 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.441817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:56.447298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 47/96] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:48:56 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=69292b9b6bc94583adb5935816723fd8 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:56.591221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5af59-fbba-43b7-965b-bcc061409122 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:56.641097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:56.641680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:56.641978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:56.642782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:56.643662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=82ce942051f24419a3122f7e40a47759, user.id=09093413150e4b37924a82390366a138) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:56.643983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:56.645484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39473e84-edd5-4f47-9ac6-c58acc424fed None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:56.657051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 50/97] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:48:56 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=82ce942051f24419a3122f7e40a47759&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:58.384415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be90b-a1e4-4cc4-bf9f-5cb4fc82819a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.384914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be90b-a1e4-4cc4-bf9f-5cb4fc82819a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.384986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be90b-a1e4-4cc4-bf9f-5cb4fc82819a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.386357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 48/98] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:58.392462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.392874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.393052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.419662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:58.420896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:58.460485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:58.515306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:48:58.554488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac365-1208-4210-8cfa-0432f24d0325 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.554787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac365-1208-4210-8cfa-0432f24d0325 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.555061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac365-1208-4210-8cfa-0432f24d0325 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.556612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 49/100] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:58.557547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:58.561744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.562038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.562320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.591659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:58.592887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:58.733589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 50/101] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 06 12:48:58.749197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150693ae-cfc4-4a13-8f36-e09ca0adb590 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:58.772985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:58.842303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:58.843125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.843419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.843731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.868587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:58.881982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:58.882883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:48:58.883695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:58.886405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 52/102] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:48:58.891779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:58.942965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10bfb1-0170-4907-9aa5-14a0456b7981 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:58.944892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:58.971772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:58.985344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:58.987092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:58.987621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:58.988063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:58.991469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:58.993275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:58.997250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 51/103] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:48:59.004282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.096726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d017939-7931-4ada-9e0e-c5e932ffcbd0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:59.133074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:59.133755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.134049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.134395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.135158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:48:59.135508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:59.136950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa0df-1701-4b30-8ac2-7f19eac1bbfe None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:59.146194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 53/104] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:48:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:59.152042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9081-36cb-4eae-a5c5-342e683b6118 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.152378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9081-36cb-4eae-a5c5-342e683b6118 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.152673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e9081-36cb-4eae-a5c5-342e683b6118 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.158294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 54/105] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:48:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:48:59.158294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9081-36cb-4eae-a5c5-342e683b6118 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.171707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12343-161d-4900-9bf6-4833709a6443 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:59.217115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:59.218450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.219695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.220590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.221346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:59.223389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:59.289715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:59.289715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e9081-36cb-4eae-a5c5-342e683b6118 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:59.322447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:59.323676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.325186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.325186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] PATH_INFO: `/v3/users/e7ccda1129574be2a38ed263f3f5daa3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.341387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] RBAC: Authorizing `identity:get_user(user_id=e7ccda1129574be2a38ed263f3f5daa3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:59.343299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e63ea3-5d5c-4732-95df-af886c0f647c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:59.345547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 55/106] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:48:59 2022] GET /identity/v3/users/e7ccda1129574be2a38ed263f3f5daa3 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:48:59.347239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.347795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.348258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.366328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 52/107] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:48:59 2022] POST /identity/v3/projects => generated 302 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:48:59.367202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.367696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:48:59.369080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:48:59.454394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 56/108] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:48:59.470889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:59.502644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.567391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2183-dd2a-4c12-aab4-88fb45c868f0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:59.646662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:59.652997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:59.654090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.654090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.654253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.684971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f02df-5657-4efe-b0b9-a2298117d22b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:48:59.722600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:48:59.723854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:48:59.724354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:48:59.724839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:48:59.736414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:48:59.744860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:48:59.745777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:48:59.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:48:59.749097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 57/109] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:48:59.760566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.779054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:48:59.780600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:48:59.855451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:48:59.962317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:48:59.972639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:48:59.992898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168464e-1373-4aeb-a7a8-ca2d2f9826ef None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.047563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.056785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.057746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.058196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.062952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.062952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:00.062952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.062952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.083438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 58/111] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:48:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:00.089741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.100879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963fbd-474e-4c30-ba35-2376179631ea None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.138918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.139812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.140104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.140383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.142669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.144301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5053745-a87f-48f8-a594-78e3ef2ed9b0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.146105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 54/112] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:48:59 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:00.147329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d5a-c524-4d4f-bb47-0f5ef903f623 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.147645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d5a-c524-4d4f-bb47-0f5ef903f623 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.147927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d5a-c524-4d4f-bb47-0f5ef903f623 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.149156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 55/113] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:00.159262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8d5a-c524-4d4f-bb47-0f5ef903f623 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.192773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.230110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138251a-4965-4be9-ba85-d80b5b30923e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.301357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.302681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.303193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.303783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.307546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.307739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8d5a-c524-4d4f-bb47-0f5ef903f623 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.307856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba8451-074e-43a7-9890-b6d26536014b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.309398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 59/114] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:00.310771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259dc8-7c60-4cb6-97e4-a002b60734c9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.311066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259dc8-7c60-4cb6-97e4-a002b60734c9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.311345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259dc8-7c60-4cb6-97e4-a002b60734c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.333705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-25259dc8-7c60-4cb6-97e4-a002b60734c9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:00.335025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-25259dc8-7c60-4cb6-97e4-a002b60734c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:00.343975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.344640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.345614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.345903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.346795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=e7ccda1129574be2a38ed263f3f5daa3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:00.347117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.348595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ecb11-c508-46b2-b6ce-68051852babd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.354591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 56/115] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/role_assignments?user.id=e7ccda1129574be2a38ed263f3f5daa3&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=d50edcbdf493472bb150805a53ba2120 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:00.355911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f5da-f5ce-48aa-ae6e-d27c99cce749 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.356214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f5da-f5ce-48aa-ae6e-d27c99cce749 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.356498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f5da-f5ce-48aa-ae6e-d27c99cce749 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.357882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 57/116] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:00.358609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235f5da-f5ce-48aa-ae6e-d27c99cce749 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.438643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.455230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.467675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 60/117] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:00.469220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19047c1-2d24-41db-92b3-59956bd53f18 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.469524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19047c1-2d24-41db-92b3-59956bd53f18 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.469843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19047c1-2d24-41db-92b3-59956bd53f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.478954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235f5da-f5ce-48aa-ae6e-d27c99cce749 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.494976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c19047c1-2d24-41db-92b3-59956bd53f18 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:00.500432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c19047c1-2d24-41db-92b3-59956bd53f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:00.521201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.522094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.522382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.522662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.524156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.525851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cc2e3-ab6c-44a1-be76-ddbf4196c8d5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.527921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 58/118] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:00.529285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe1a8-b4f7-4990-99e7-35e51f1c1b53 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.529582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe1a8-b4f7-4990-99e7-35e51f1c1b53 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.529865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fe1a8-b4f7-4990-99e7-35e51f1c1b53 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.531249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 59/119] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:00.532249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fe1a8-b4f7-4990-99e7-35e51f1c1b53 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.594143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 61/120] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:00.596397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.596836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.597132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.615058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:00.616446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:00.651575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fe1a8-b4f7-4990-99e7-35e51f1c1b53 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.692677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.693480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.693804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.694128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.697519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:00.698431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.706524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:00.715444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:00.717503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 60/122] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:00.719294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.731156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.756565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:00.808523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73a479-e8ec-48df-9582-9a6c2b62974f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.827104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1ab4-820f-445e-a616-d5d43ebbbd71 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:00.847914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.848863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.849206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.849495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/09093413150e4b37924a82390366a138/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.851717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, user_id=09093413150e4b37924a82390366a138, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:00.853301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:00.865179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:00.865983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:00.866272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:00.866551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:00.877849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:00.885497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:00.886606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 61/123] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:00.887416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:00.939574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 63/124] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:00 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/09093413150e4b37924a82390366a138/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:00.948099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.008891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:01.080242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bd71f-89bb-43b3-9457-440334f3f97e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.131203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3f9d-91f0-4244-8fcf-b48f1008b6c8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.147761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:01.166961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.167806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.168096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.168375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.169133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:01.169441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.170850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.186101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.186822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.194946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.196608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.196910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.197194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.227810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:01.230106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:01.231162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:01.232099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 64/126] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:01.236884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.372109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bc974-98b8-43ae-846c-fd7da73dc807 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.405215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:01.411242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.411957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.412252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.412536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.413298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:01.413613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.415009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.425507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 63/127] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.427009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.433730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c97c5-2067-4eef-a672-61b24b90e3a9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.508068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.508877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.509170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.509455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.510870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.512376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.515215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 65/128] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.520864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.590415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5723da-de95-4dee-97dd-3a345f80b913 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.608208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:01.632792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.633684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.633980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.634268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.635071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:01.635391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.637171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.647304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 64/129] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.651945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.743992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:01.760028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3053fe-bdac-4c10-b63b-44cd977caaf8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.821951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebbfd-9ac0-4355-8b21-d30fbfaba6a1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:01.826431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.827317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.827627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.827906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.832880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.834371 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.836091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 66/130] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.836863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:01.891341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:01.893328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:01.893625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:01.893914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:01.895864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:01.897294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:01.898985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 65/131] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:01.899780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:02.026493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13fb05-4c42-475a-a9ee-5588a3d193ad None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.038474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:02.082939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.083837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.084119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.085384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.086723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.088219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.091346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 67/132] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:02.092911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:02.108435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d831-c09b-4246-a9cd-169d346c09a6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.147898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:02.176248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.177138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.177437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.177723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] PATH_INFO: `/v3/projects/82ce942051f24419a3122f7e40a47759` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.178976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] RBAC: Authorizing `identity:get_project(project_id=82ce942051f24419a3122f7e40a47759)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.180461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.182338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 66/133] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:01 2022] GET /identity/v3/projects/82ce942051f24419a3122f7e40a47759 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:02.182941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:02.282742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc87f-b5ed-40f0-a845-015f658e6360 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.310766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d311a-e77f-443d-8401-2f257335c13f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.354364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.355371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.355843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.356139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.357355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.358817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.362128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 67/134] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:02 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:02.363046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:02.376896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.377930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.378224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.378505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/09093413150e4b37924a82390366a138/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.385081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, user_id=09093413150e4b37924a82390366a138, role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.386579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.434613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:02.478163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15f04-c457-4ae4-83ea-c1cc34e39459 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.497212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 68/135] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:02 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/09093413150e4b37924a82390366a138/roles/69292b9b6bc94583adb5935816723fd8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:02.503801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:02.535557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.536846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.537345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.537877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] PATH_INFO: `/v3/projects/82ce942051f24419a3122f7e40a47759/users/09093413150e4b37924a82390366a138/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.543555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:02.545895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce942051f24419a3122f7e40a47759, user_id=09093413150e4b37924a82390366a138, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.547691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfafe8-68b7-41ac-968a-8215858cc9b4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.616506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a9a21-99e4-438d-86f8-8bd20a679288 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:02.662023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:02.662023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.662023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.662023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/1492cd2eb7c64ad8959375e22df26ab7/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.663435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, user_id=1492cd2eb7c64ad8959375e22df26ab7, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:02.665507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:02.670408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 68/136] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:02 2022] PUT /identity/v3/projects/82ce942051f24419a3122f7e40a47759/users/09093413150e4b37924a82390366a138/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:02.672596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b031f-63fe-44aa-bf1d-3441a9f970b9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.673580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b031f-63fe-44aa-bf1d-3441a9f970b9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.673938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b031f-63fe-44aa-bf1d-3441a9f970b9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.689074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 69/137] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:02.694340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:02.694340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:02.694340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:02.732770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:02.734482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:02.807228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 69/138] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:02 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/1492cd2eb7c64ad8959375e22df26ab7/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:02.848330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:02.894074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:03.037568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:03.050448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb519-a475-4775-82e9-b82891f48043 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:03.092598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:03.093330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.093623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.093909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.095673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:03.097257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8910920-d7b0-4456-98f5-04408b963009 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:03.098933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 70/140] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:03.104751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:03.137479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4de50-b385-4540-ab4b-4944f317fb77 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.137768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4de50-b385-4540-ab4b-4944f317fb77 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.138021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4de50-b385-4540-ab4b-4944f317fb77 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.139690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 71/141] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:03.158317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.158763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.159057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.165286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:03.196644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:03.197868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:03.221356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3bc5f-71fd-4c2b-906e-72e1dcaa01d2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:03.258056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:03.258739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.259024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.259302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.260066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:03.261577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:03.330991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 72/142] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:03.356622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 71/143] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:03 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:03.366245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:03.498984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:03.510429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece9133-ca1d-4e76-a564-fbad9b164250 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:03.556287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:03.557111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.557404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.557687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.573238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-4b61b7d1-1abc-45e2-a021-328751d8be04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:03.581678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:03.582609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:03.583398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 73/144] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:03.590074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:03.748448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc66c07-7f30-416b-9aeb-e3a650a50e27 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:03.751441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:03.796506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:03.797183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.797464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.797911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.798717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:03.799021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:03.800431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:03.805265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de073a-e105-4f0d-bf66-c267a09c9d9c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.805555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de073a-e105-4f0d-bf66-c267a09c9d9c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.805838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de073a-e105-4f0d-bf66-c267a09c9d9c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.807213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 74/145] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:03.812274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:03.814380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:03.814380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:03.816195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 72/146] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:03.821560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:03.831186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:03.833118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:03.946747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 75/147] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:03.988891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2c37e-65e9-415c-921e-4ee8827c3a81 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.026522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.046747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.048807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.049090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.049365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] PATH_INFO: `/v3/users/e7ccda1129574be2a38ed263f3f5daa3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.050710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] RBAC: Authorizing `identity:get_user(user_id=e7ccda1129574be2a38ed263f3f5daa3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:04.052188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:04.059039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 73/148] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:03 2022] GET /identity/v3/users/e7ccda1129574be2a38ed263f3f5daa3 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:04.061713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.124837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:04.171928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:04.208190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03b03-4dda-4923-87d6-72841c3f9087 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.216501 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3b452-d362-48e6-9d4b-1d2e11e1ab14 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.264729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.265680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.265968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.266248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.272384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:04.273384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.273859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:04.274287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.274573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.274848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.275606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 74/149] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:04 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:04.283064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.292022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:04.299940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:04.300824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:04.302002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 76/150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:04.306734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.470159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66c34-9db8-4b50-8ffc-b8bf8886d34a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.473055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:04.494843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ad6c9-78c7-4b0e-b77e-66e9339f1954 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.541667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.542485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.542765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.543035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/e7ccda1129574be2a38ed263f3f5daa3/roles/d50edcbdf493472bb150805a53ba2120` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.546312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, user_id=e7ccda1129574be2a38ed263f3f5daa3, role_id=d50edcbdf493472bb150805a53ba2120)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:04.548413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:04.560362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.561037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.561322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.561600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.562354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:04.562671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:04.564394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:04.573489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:04.578651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.592650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:04.642311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 75/152] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:04 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/users/e7ccda1129574be2a38ed263f3f5daa3/roles/d50edcbdf493472bb150805a53ba2120 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:04.718227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e02393-a46a-49cb-8d10-02e4d6171fdc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.769170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.770061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.770346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.770621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.771877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:04.773287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:04.774994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 78/153] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:04 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:04.780562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:04.899636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac76b3c-5fe9-4e27-a440-e37294629b7e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:04.948846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:04.949496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:04.949778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:04.950050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:04.986294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:05.039510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:05.041054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:05.160534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 76/154] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:05.166699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:05.255205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:05.286357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c640-33ce-4c7a-ad9e-2bc856666164 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:05.329536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:05.330457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:05.330739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:05.331013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:05.332280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:05.333730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a8ca3-c91c-4492-aa05-3573affbf5cd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:05.335675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 79/155] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:05 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:05.341174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:05.432274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:05.466486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29793b2-7a0d-4716-94cb-25f058f8adf9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:05.503932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:05.504637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:05.504925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:05.505250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:05.506097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=09093413150e4b37924a82390366a138) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:05.506408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:05.507891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233803f7-1a94-4a76-8d8b-b36553d7ff14 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:05.514517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:05 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:06.569788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d9e3-9b58-4e77-9027-bb2ed9fa1d6b None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.570367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d9e3-9b58-4e77-9027-bb2ed9fa1d6b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.570367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d9e3-9b58-4e77-9027-bb2ed9fa1d6b None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.571996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 80/157] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:06.577783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b23-b808-4278-93a9-4cc3d5274948 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.578622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b23-b808-4278-93a9-4cc3d5274948 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.579811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b23-b808-4278-93a9-4cc3d5274948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.604519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ba0e8b23-b808-4278-93a9-4cc3d5274948 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:06.606059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ba0e8b23-b808-4278-93a9-4cc3d5274948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:06.698302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 78/158] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:06.734928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76d9e3-9b58-4e77-9027-bb2ed9fa1d6b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:06.774945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fa95-5902-44f3-9f38-d7a69cb22999 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.775651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fa95-5902-44f3-9f38-d7a69cb22999 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.776139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fa95-5902-44f3-9f38-d7a69cb22999 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.777960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 79/159] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:06.784489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a698-4bd8-4628-86c3-d0b15a03b53b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.785033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a698-4bd8-4628-86c3-d0b15a03b53b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.785536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a698-4bd8-4628-86c3-d0b15a03b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.816498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3739a698-4bd8-4628-86c3-d0b15a03b53b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:06.818031 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3739a698-4bd8-4628-86c3-d0b15a03b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:06.896337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76d9e3-9b58-4e77-9027-bb2ed9fa1d6b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:06.935329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:06.966230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:06.967058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.967345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.967652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.970155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 80/160] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:06.972259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42408-cd82-4739-a198-d55be4d5a429 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.972558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42408-cd82-4739-a198-d55be4d5a429 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.972842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42408-cd82-4739-a198-d55be4d5a429 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.974432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 81/161] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:06.980300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:06.980596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:06.980882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:06.994125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:07.002902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:07.003923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:07.004711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:07.008770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 81/162] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:07.014193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.015047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:07.016360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:07.017106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.149160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 82/163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:07.149944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.227136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80f8a-9204-49be-b50f-94f0a11fe6ed None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.287268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.287972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.288260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.288541 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.289299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:07.289609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:07.291015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:07.312645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 82/164] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:07.313349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.334253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f8f61-265e-498a-96fe-63f4ec503d30 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.382797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.402053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.402782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.403067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.403570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.428417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:07.434616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:07.437034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:07.437931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 83/165] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:07.439584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.478745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13f71-a8a1-4cdf-b7c1-a64d36bdf652 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.518485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.519327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.519639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.519920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.531205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:07.540266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:07.541223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 83/166] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:07.547019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.612308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049a3ba-a3ea-44cb-897f-e6a061b43f2b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.650126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e6962-a6bf-4890-b71f-8f987a5927c4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.669676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.670705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.671095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.671473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.674120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:07.675967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:07.677543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.679646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 84/167] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:07.680558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.690401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.693513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.693513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.693513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.693513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:07.693513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:07.694904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:07.705454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 84/168] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:07.706505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:07.766579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.815576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7e15-7058-4930-96c8-670d7e84b50d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.851688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.852614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.853042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.853464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.854273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e7cc0-f558-486b-9f04-0696cde5de4b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:07.913028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:07.927973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:07.929713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1d0a6-df1a-457c-a60a-e565053d2db4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:07.975325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:07.976072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:07.976370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:07.976641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:07.977404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:07.977719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:07.979109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.013508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 85/169] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:08.014377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.037382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 85/170] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:08.038924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384d78-0d43-45c7-a0af-e66e5c3efb40 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.039406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384d78-0d43-45c7-a0af-e66e5c3efb40 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.039872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384d78-0d43-45c7-a0af-e66e5c3efb40 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.041776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 86/171] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:08.042623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384d78-0d43-45c7-a0af-e66e5c3efb40 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.150427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.164335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384d78-0d43-45c7-a0af-e66e5c3efb40 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.209470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.210806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.211286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.212440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] PATH_INFO: `/v3/users/09093413150e4b37924a82390366a138` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.213894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] RBAC: Authorizing `identity:get_user(user_id=09093413150e4b37924a82390366a138)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.215585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b47ea9-581e-4192-bfc7-f0cb1d6e5300 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.218177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 87/172] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/users/09093413150e4b37924a82390366a138 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:08.219834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.220348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.220821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.239070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:08.241046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:08.289502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94451fb-1120-4bf2-b4c0-efc2a0bd7a8c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.315888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.336188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 88/173] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:08.336887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.357355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.360095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.360378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.360657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] PATH_INFO: `/v3/users/1492cd2eb7c64ad8959375e22df26ab7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.364635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] RBAC: Authorizing `identity:get_user(user_id=1492cd2eb7c64ad8959375e22df26ab7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.366090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.372265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 86/174] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/users/1492cd2eb7c64ad8959375e22df26ab7 => generated 247 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:08.374251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.468759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.478545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9170c-c1c1-4e8f-9b17-dde9e0c87257 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.523069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.524038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.524326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.524605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] PATH_INFO: `/v3/projects/82ce942051f24419a3122f7e40a47759` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.525788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] RBAC: Authorizing `identity:get_project(project_id=82ce942051f24419a3122f7e40a47759)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.527247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.529162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 89/175] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/projects/82ce942051f24419a3122f7e40a47759 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:08.529731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.562769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8982-0c2a-4dfc-91dc-b32ef726e78b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.599959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.600617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.600904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.601205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.637416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1963e-cafd-4f8e-84b5-04c925f7fcbe None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.649202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.676566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.678056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884f07b-3833-41bb-8b03-ada3736d7179 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.679141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.680138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.680433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.681514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.693342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:08.700979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:08.701879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:08.702715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 90/176] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:08.703393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.721755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.796765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 87/177] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:08.798944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd64-5f71-4ebb-afe3-34bae7d08334 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.799244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd64-5f71-4ebb-afe3-34bae7d08334 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.799555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd64-5f71-4ebb-afe3-34bae7d08334 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.800967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 88/178] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:08.805363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd64-5f71-4ebb-afe3-34bae7d08334 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:08.817190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27e0ba-be12-46c2-90bf-e9e860c57c12 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.855033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.855780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.856063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.856347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.888187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.917258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd64-5f71-4ebb-afe3-34bae7d08334 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:08.929102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.930514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.945502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:08.958896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:08.959573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.959861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.960136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.960963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=82ce942051f24419a3122f7e40a47759, user.id=09093413150e4b37924a82390366a138) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:08.961279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:08.962835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31e304-37de-4be3-a620-950fddbdd495 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:08.975890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 89/179] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=82ce942051f24419a3122f7e40a47759&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:08.977317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338135-4979-4209-bd94-7a69d602f000 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:08.977611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338135-4979-4209-bd94-7a69d602f000 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:08.977998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0338135-4979-4209-bd94-7a69d602f000 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:08.979550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 90/180] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:08.984352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0338135-4979-4209-bd94-7a69d602f000 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.048193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 91/181] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:09.049504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.107892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0338135-4979-4209-bd94-7a69d602f000 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.155171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.156272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.157060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.157682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.158782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:09.159110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.161176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0f11-8121-483d-8ab6-c2db26dfaf9a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.165782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252c4f3-8b3f-442d-9c41-c5c8fd5e8f31 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.168836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.173964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 91/182] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.175473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.175817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.176103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.179387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.197253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:09.198483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:09.203918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.205936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.205936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.205936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.206701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.208608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bfd0a-885d-4f00-9cbe-c718dd58b73d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.211188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 92/183] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.212703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afad7-3830-4dc5-8dcb-341f5c629b35 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.212994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afad7-3830-4dc5-8dcb-341f5c629b35 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.213426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afad7-3830-4dc5-8dcb-341f5c629b35 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.215519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 93/184] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:09.216616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.216913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.217283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.239359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:09.240527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:09.274025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 92/185] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:09.274875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.311802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 94/186] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:09.312632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.383323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b12f9-d8ff-49f3-91e7-1cad022314c6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.411397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.412615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72b4b-508f-4204-8e05-5fb98c4c62cb None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.417146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.418009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.418295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.418571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.419785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.421234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.423815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.423931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 93/187] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.424686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.450796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.451705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.451993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.452276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.466309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.467796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef10c66-0104-4036-a519-d23f48f4fe8e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.470441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 95/188] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.471730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.472023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.472308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.487892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:09.489067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:09.529836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2fbb-4fad-4ca4-883e-b926b84ffdf1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.555441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 96/189] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:09.556294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.577056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.577712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.577983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.579057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.579985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=09093413150e4b37924a82390366a138) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:09.580294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.581736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.587519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 94/190] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/role_assignments?user.id=09093413150e4b37924a82390366a138&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=69292b9b6bc94583adb5935816723fd8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.588310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.658657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.673022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.678044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e3b29-736b-4752-a597-71a4fe3bc612 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.701733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5023e5-6d22-461b-b062-5076dc1af3ef None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.718207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.720605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.721188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.721635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.723162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.725209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.726904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 97/191] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.727726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.745141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.746325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.746810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.747373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.760480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:09.768861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:09.769837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:09.770664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 95/192] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:09.771353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.855021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa038-f546-450b-8f9b-66c08747701b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.889063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.889720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.890006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.890097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e2e9a-f1e0-4a3d-997d-64605c29259b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:09.890285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:09.891703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=1492cd2eb7c64ad8959375e22df26ab7) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:09.892017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:09.893452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:09.899460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 98/193] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/role_assignments?user.id=1492cd2eb7c64ad8959375e22df26ab7&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:09.900178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:09.928291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.938667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:09.944556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:09.944556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:09.944860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:09.945086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.015133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820602-67b5-463a-9def-7c0985fad4fb None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.025087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.027217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.052161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.053243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.053533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.053821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.065950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:10.073929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:10.074896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:10.075786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 99/194] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:10.076929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.149230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 96/195] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:10.150092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.177358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.187723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.197111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e014-162d-4fbd-a60e-a0e654c69e30 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.230317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.230981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.231266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.231568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.232270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.233810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.252306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a7f69-b23c-4739-886b-9dcba8f8ad14 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.285950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.286610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.286896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.287171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.287942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:10.288250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.289632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.297322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 97/196] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.298094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.352339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 100/197] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:10 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:10.353022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.394762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.413503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e700495-5d0a-4594-96ec-06ffb0c7a47c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.453181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.454396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.454682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.455093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.455895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:10.456206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.457624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.466978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 98/198] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.471891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.478784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b868d-e2b7-4362-87d4-19a2c1bda000 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.514693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.515630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.515964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.516264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.517512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.519037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.520996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 101/199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.521631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.541236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.589942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd940a-0439-41fb-a270-8cd084f783dc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.634227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.635102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.635397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.635729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.636937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.638407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.641294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 99/200] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.641294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.646663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5bfb3-02f1-4ced-9e9f-fb7cfa7187b8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.660971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.698273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.699061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.699350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.699653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] PATH_INFO: `/v3/users/e7ccda1129574be2a38ed263f3f5daa3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.700898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] RBAC: Authorizing `identity:get_user(user_id=e7ccda1129574be2a38ed263f3f5daa3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.702342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.704725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 102/201] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/users/e7ccda1129574be2a38ed263f3f5daa3 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.705523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.780801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801dd32-407c-444a-bf64-fe3f13db4f57 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.819266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.819834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.819939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.820343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.820446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.821208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=75c5e319456a48849152a2909aeef5c6) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:10.821523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:10.822966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:10.829909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/role_assignments?user.id=75c5e319456a48849152a2909aeef5c6&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:10.833444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:10.847604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7104fa-bd9f-4800-afb6-497ef13275e0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.904018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.904986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.906240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.907913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:10.932650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:10.957106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bc64-7b39-4df4-80ee-ac114617d542 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:10.997557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:10.998229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:10.998514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:10.998792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:11.014706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.018343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.100447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.101947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.168640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:11.190557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:11.196315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:11.221764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:11.267763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 101/204] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:11.274718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:11.362045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d732b-02f9-40f3-afd9-2915f55918dc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:11.380073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0c2df-54ec-4f94-aebd-2d93d4c3aa20 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:11.417169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:11.418030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:11.418310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:11.418582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:11.419789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.421227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.423565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 102/205] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:11 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:11.432521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:11.433385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:11.433670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:11.433944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:11.435194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.436461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:11.436669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.438924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 104/206] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:11 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:11.444535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:11.520243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:11.537027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:11.618541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fb10f-56fb-498a-99ae-ef0bd02d51a9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:11.631407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73a57-fa45-4f09-b0a7-ad9bffca796b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:11.684272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:11.684921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:11.685203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:11.685478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:11.686309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a, user.id=e7ccda1129574be2a38ed263f3f5daa3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:11.686618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.688162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d778-7428-4070-8c13-244c7d1e2389 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.695156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:11.695839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:11.696113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:11.696513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:11.698259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=75c5e319456a48849152a2909aeef5c6) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:11.698787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:11.699808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 103/207] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:11 2022] GET /identity/v3/role_assignments?user.id=e7ccda1129574be2a38ed263f3f5daa3&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=d50edcbdf493472bb150805a53ba2120 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:11.700857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f97574-4e99-44b9-987e-0f9885a55e37 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:11.707571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 105/208] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:11 2022] GET /identity/v3/role_assignments?user.id=75c5e319456a48849152a2909aeef5c6&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=69292b9b6bc94583adb5935816723fd8 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:13.007712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81029-b020-4725-b05e-0dd64a7fd0f3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.008699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81029-b020-4725-b05e-0dd64a7fd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.009191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81029-b020-4725-b05e-0dd64a7fd0f3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.011166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 104/209] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:13.016818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.017760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.018267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.035828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326dfe-0281-4d1b-9da4-56351817414b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.036460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326dfe-0281-4d1b-9da4-56351817414b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.036970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41326dfe-0281-4d1b-9da4-56351817414b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.038936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 105/210] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:13.043686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:13.044582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:13.045728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.046290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.047191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.072682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:13.074562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:13.127238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 106/211] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:13.146693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 106/212] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:13.151862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.172917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.202261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.219326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.275366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d33a63-a9ce-4f15-93fb-df689dcd191b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.282331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbc5eb-f09a-454f-884e-f19f2102027e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.319703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.320334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.320528 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.320779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.321052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.321926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.322406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.323008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.324535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:13.326195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:13.333180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:13.333445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:13.334438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:13.341337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:13.342285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:13.343123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:13.348143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 107/214] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:13.349190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.460277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45c13-82e6-4ce3-9634-b02541cb9162 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.462462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4977838-ca9c-4cbc-a40c-9de5b422a317 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.463793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.472961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.497957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.498576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.498852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.499136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.499256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.499409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.499500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.499848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.500777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:13.501799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:13.502114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:13.502207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d4da9-9b23-41ad-a502-a1d48d2b6f17 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:13.503543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cc1fd-0c95-4c8b-bb43-3add4da9780a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:13.513148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 108/215] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:13.516960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc41c5-df4d-400d-9484-ae7347ad47f0 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.517251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc41c5-df4d-400d-9484-ae7347ad47f0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.517566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc41c5-df4d-400d-9484-ae7347ad47f0 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.518992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 109/216] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:13.519704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc41c5-df4d-400d-9484-ae7347ad47f0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.611627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 108/217] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:13 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:13.614136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.614429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.614713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.632977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:13.634339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:13.634957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc41c5-df4d-400d-9484-ae7347ad47f0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.698271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.699897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.700377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.700824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] PATH_INFO: `/v3/users/33d9248cf7ec4da48d189b6137d3b30f` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.719133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 109/218] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:13.722683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] RBAC: Authorizing `identity:get_user(user_id=33d9248cf7ec4da48d189b6137d3b30f)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:13.724519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:13.726607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 110/219] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/users/33d9248cf7ec4da48d189b6137d3b30f => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:13.732476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.745870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:13.783933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.844655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:13.854331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cecef-bc2f-4e37-97b4-458a0caebffd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.881198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c778f9-e625-4855-afb2-31c09caadeed None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:13.901535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.902581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.903039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.903784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.924989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:13.927496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:13.927496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:13.927496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:13.938543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:13.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:13.947145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:13.948013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 111/220] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:13.953857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.006967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.007642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.074563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.096570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c3d-131d-45ca-9e3f-0cd902abfea8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.121117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.129619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 110/221] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:14.134890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.274191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.274790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.275074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.275348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.276138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:14.276446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.278201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a4ab-f300-447d-a764-d5253e878c99 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.288121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 112/222] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:14.289488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102e56-40e9-4d4a-8353-cc023e0670e4 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.289701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102e56-40e9-4d4a-8353-cc023e0670e4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.289977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102e56-40e9-4d4a-8353-cc023e0670e4 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.291389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 113/223] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:14.295580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102e56-40e9-4d4a-8353-cc023e0670e4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.306321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2d49-fabb-422f-94cb-e974db5f4e2f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.343642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.345553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.345992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.346406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.347891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.349633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cbf43-7d44-446f-bcc1-55773f9d1cc2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.351979 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 111/224] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:14.353503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.353936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.354398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.378931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:14.380456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:14.419571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102e56-40e9-4d4a-8353-cc023e0670e4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.444432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.460848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.461043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 112/225] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:14.461135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.461135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.461135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.461135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.461135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.462746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 114/226] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:14.463719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.467471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.485189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.575842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07515a-f5c4-4447-add2-e7b1c27ef613 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.588288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a97ba-6cc7-4173-8cd2-06b38dcd8a0d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.612456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.613129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.613418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.613789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.614531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=33d9248cf7ec4da48d189b6137d3b30f) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:14.614843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.616363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.622466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 115/227] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/role_assignments?user.id=33d9248cf7ec4da48d189b6137d3b30f&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:14.628542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.634789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.636224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.637459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.638139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.641932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.643703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:14.648462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 113/228] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:14.657902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.793012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.804814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:14.832214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e2bb-a275-4c95-8d38-32d05e738f54 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.877987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b889-cfc5-4e84-ab61-59fd1824b7b9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:14.888232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.889057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.889446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.889732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.911681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:14.931189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:14.932161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:14.932988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 116/229] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:14.941138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:14.946787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:14.947717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:14.948009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:14.948288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/75c5e319456a48849152a2909aeef5c6/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:14.951105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, user_id=75c5e319456a48849152a2909aeef5c6, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:14.952591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:15.028673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 114/230] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:14 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/75c5e319456a48849152a2909aeef5c6/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:49:15.083309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a2ba-77a8-4129-8687-5e9e9b022c8a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:15.124413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:15.125826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:15.126187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:15.126562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:15.127303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:15.127642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:15.129061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:15.135619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:15.143863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 117/231] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:15.147120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:15.290142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f332-8175-4804-9826-c03f100d25b9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:15.322839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:15.346724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:15.346724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:15.346724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:15.346724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:15.347067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:15.347067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:15.347067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 115/232] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:15 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:15.352538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:15.471580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aba34-e64c-4247-b14d-f3b7706126d7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:15.533266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:15.534142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:15.534429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:15.534707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:15.535930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:15.537362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25306361-c310-42ab-ae0d-735e78913b76 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:15.539369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 118/233] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:15 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:15.544851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:15.691708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598798b5-da3e-4433-aec0-77acea9e84ad None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:15.742197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:15.742197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:15.742197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:15.742197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/75c5e319456a48849152a2909aeef5c6/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:15.744540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, user_id=75c5e319456a48849152a2909aeef5c6, role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:15.746290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fac34-7efc-490d-96db-d81b081574bc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:15.863574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:15 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/75c5e319456a48849152a2909aeef5c6/roles/69292b9b6bc94583adb5935816723fd8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:16.218117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ac0b-c3d1-4e91-be4c-e8aeeead5965 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.218725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ac0b-c3d1-4e91-be4c-e8aeeead5965 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.218725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ac0b-c3d1-4e91-be4c-e8aeeead5965 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.220212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 119/235] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:16.233713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.234744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.234819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.258936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:16.260171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:16.312172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:16.341202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 117/236] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:16.369383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ac0b-c3d1-4e91-be4c-e8aeeead5965 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:16.479632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:16.528347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ac0b-c3d1-4e91-be4c-e8aeeead5965 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:16.584773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:16.585582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.585868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.586143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.600402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-a0a7bc1e-6525-49cb-9016-3bfcc3f90f60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:16.608131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:16.609061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:16.609967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 120/237] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:16.615518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:16.720183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb80b-3179-45d8-8468-0713799604e8 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.720547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb80b-3179-45d8-8468-0713799604e8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.720744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb80b-3179-45d8-8468-0713799604e8 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.722134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 121/238] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:49:16.732997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.733263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.733482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.743671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566714e-522b-4c63-89f6-52e9c8acd414 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:16.770941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:16.772636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:16.804797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:16.805827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:16.806418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:16.807691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:16.808808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:16.810590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:16.812999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:16.830437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 118/239] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:16.836355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:16.919957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 122/240] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:16.923557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:16.959577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:16.987337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097bc71-4f1d-4c65-9dac-6f93f824b219 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.030805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.032319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.032618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.032902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] PATH_INFO: `/v3/users/5e8bda70568e4c6d90b49e991772d7ae` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.056983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] RBAC: Authorizing `identity:get_user(user_id=5e8bda70568e4c6d90b49e991772d7ae)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.058459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.060224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 119/241] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:16 2022] GET /identity/v3/users/5e8bda70568e4c6d90b49e991772d7ae => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:17.071556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.084061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.164540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2da44-4229-4f6f-9d54-17d957c6c7bd None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.232481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.233089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.233338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.233619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.235099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.236589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff1a8a-1cea-4513-a1a0-effc82a431a3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.238440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 123/242] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:17.239386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d4e7-5b26-4009-8fad-ad2239205208 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.243750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d4e7-5b26-4009-8fad-ad2239205208 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.244054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d4e7-5b26-4009-8fad-ad2239205208 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.244717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fddb28-59b4-404d-a484-64aa474630fa None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.245496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 124/243] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:17.246396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d4e7-5b26-4009-8fad-ad2239205208 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.253496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.283450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.284477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.285056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.285619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.362101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.364049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e883-a750-454c-89a2-7ea5da7471f9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.385479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d4e7-5b26-4009-8fad-ad2239205208 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.420376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.432822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.433506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.433795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.434077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.434801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.436540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.471213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.475840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 120/244] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:17.478282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.478576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.478857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.499601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:17.500764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:17.548931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 125/245] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:17 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:17.549736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.612326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 121/246] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:17.677728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.766054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6d9ea-ecb5-45f1-9ca5-20f6d6658025 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.811283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.813018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.813609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.814236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.815712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.817385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.819664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 126/247] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:17 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:17.825428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.836629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc08d4-55ef-4e80-a2bc-5c1f0819b92e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.865052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.873279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.883992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.883992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.883992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.885656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:17.894908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:17.895869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:17.896774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:17.899149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 122/248] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:17.899742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:17.910795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:17.945574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebb402-3068-4673-b0d9-14a06de33fef None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:17.985740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:17.986406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:17.986696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:17.987015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:17.987896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=5e8bda70568e4c6d90b49e991772d7ae) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:17.988217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:17.990443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:17.996317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 127/249] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:17 2022] GET /identity/v3/role_assignments?user.id=5e8bda70568e4c6d90b49e991772d7ae&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=d50edcbdf493472bb150805a53ba2120 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:18.026636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f0489-3f13-49f6-90c7-0b8ccab1bb73 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.066180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.067236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.067780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.068259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.069350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:18.069890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:18.071668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c6c4-2e98-4385-b6af-c042e1594140 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:18.082312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 123/250] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:18.087923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.176497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa50c-18c7-4acf-8ec4-a0da9c5eb6e4 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.177266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa50c-18c7-4acf-8ec4-a0da9c5eb6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.177747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa50c-18c7-4acf-8ec4-a0da9c5eb6e4 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.179385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 124/251] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:18.185856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.186475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.187033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.219561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:18.220806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:18.250521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b471-80cb-4467-8e28-0541060f3ad1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.272463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:18.288047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:18.300996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.302219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.302575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.303067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] PATH_INFO: `/v3/users/33d9248cf7ec4da48d189b6137d3b30f` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.304680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] RBAC: Authorizing `identity:get_user(user_id=33d9248cf7ec4da48d189b6137d3b30f)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:18.306185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:18.308827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 128/252] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:18 2022] GET /identity/v3/users/33d9248cf7ec4da48d189b6137d3b30f => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:18.315234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.315477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 125/253] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:18.341225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.491717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702729-f7d6-41bc-a9d5-5789041c557c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.527343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bc528-43dc-45be-9d55-9ab0c1a4fbe6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.552895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.553694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.553980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.554257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.555617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:18.557077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:18.566940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 129/254] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:18 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:18.576079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.615337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215591-add8-495c-b964-71304b497709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.616176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215591-add8-495c-b964-71304b497709 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.616462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215591-add8-495c-b964-71304b497709 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.616743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215591-add8-495c-b964-71304b497709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.636866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215591-add8-495c-b964-71304b497709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9a215591-add8-495c-b964-71304b497709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:18.652866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:18.653795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:18.654598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:18.655205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 126/255] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:18.662359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215591-add8-495c-b964-71304b497709 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.668988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:18.715263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:18.736446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b4583-bedd-44f0-bdeb-6a01fcdbdf41 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.778017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.778913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.779199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.779480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/33d9248cf7ec4da48d189b6137d3b30f/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.782825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, user_id=33d9248cf7ec4da48d189b6137d3b30f, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:18.784332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651e93a-904f-4cdd-875c-dffa3616c4c7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:18.803758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215591-add8-495c-b964-71304b497709 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:18.839950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:18.840627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.840916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.841194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.841941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:18.842250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:18.844547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:18.858527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 130/256] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:18 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/33d9248cf7ec4da48d189b6137d3b30f/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:18.860318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3930c4-d69e-48c5-849a-b568087b64d5 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.860617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3930c4-d69e-48c5-849a-b568087b64d5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.860902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3930c4-d69e-48c5-849a-b568087b64d5 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.862421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 131/257] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:18.869801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 127/258] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:18.870097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:18.870292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:18.870563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:18.875277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:18.904893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:18.911508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:19.038843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 132/259] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:19.082805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d1f8-8cf2-407c-a1f4-87eb8d27b102 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.099968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:19.126315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.131920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.132820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.137912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.137912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.137912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:19.137912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:19.137912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 128/260] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:18 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:19.147682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.198278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:19.261369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a0965-97cc-485e-9417-7bc974726833 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.299021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.300227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.300709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.301202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.314222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:19.322740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:19.323774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:19.324582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:19.327254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 133/261] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:19.334801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.373752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bb5ae-ac93-439a-ac35-3bf96e916c97 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.447408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bd0ef-70ed-4e1c-a615-dca0cd2830b0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.456554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:19.486228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.486913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.487194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.487471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.488257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:19.488561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:19.489951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:19.498536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 134/262] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:19.506322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.512224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0048-5336-446b-9ac0-873037092274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.512899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0048-5336-446b-9ac0-873037092274 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.513187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0048-5336-446b-9ac0-873037092274 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.513464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a0048-5336-446b-9ac0-873037092274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.592035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:19.636138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0048-5336-446b-9ac0-873037092274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:19.637618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a0048-5336-446b-9ac0-873037092274 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:19.642523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045dbce-a560-4378-b2e9-70846605d9a6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.691901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.692790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.693070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.693344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] PATH_INFO: `/v3/users/75c5e319456a48849152a2909aeef5c6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.695162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] RBAC: Authorizing `identity:get_user(user_id=75c5e319456a48849152a2909aeef5c6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:19.696631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:19.698429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 135/263] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/users/75c5e319456a48849152a2909aeef5c6 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:19.704738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.779773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:19.859316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 129/264] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 12:49:19.866173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0048-5336-446b-9ac0-873037092274 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:19.891162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a531b61-b75b-4385-bd9b-816e3ab69743 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:19.949995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:19.950655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:19.950940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:19.951218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:19.993508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:20.029694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a0048-5336-446b-9ac0-873037092274 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:20.085575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:20.086439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:20.086818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:20.086988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:20.088260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:20.089772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:20.091700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 130/265] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:20.097459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:20.097606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:20.098928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:20.173932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:20.309230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2f871-6056-4e3e-9875-414d8c3d5aa3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:20.340530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 136/266] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:20.346931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:20.371663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:20.373030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:20.373521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:20.374022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:20.376789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=75c5e319456a48849152a2909aeef5c6) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:20.377885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:20.379745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:20.398127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 131/267] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:20 2022] GET /identity/v3/role_assignments?user.id=75c5e319456a48849152a2909aeef5c6&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:20.490206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7088a1-1f4e-41c6-8bb9-6d0777448c70 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:20.524041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:20.532030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:20.532954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:20.533243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:20.533527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:20.534756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:20.536251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8be2-b72b-40f4-9d9b-166189eb20d0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:20.538367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 137/268] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:20 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:20.544133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:20.550058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:20.705998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c21f9-7521-48d5-8df7-263506dd29be None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:20.758253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:20.759286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:20.759807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:20.760315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:20.761368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=75c5e319456a48849152a2909aeef5c6) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:20.761887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:20.763609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8d04f-6c4b-4a45-9831-5bc395f8d5ff None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:20.771496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 132/269] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:20 2022] GET /identity/v3/role_assignments?user.id=75c5e319456a48849152a2909aeef5c6&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=69292b9b6bc94583adb5935816723fd8 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:21.100497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825528-036b-4445-a4f4-a1214f95a236 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.100843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825528-036b-4445-a4f4-a1214f95a236 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.101015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49825528-036b-4445-a4f4-a1214f95a236 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.102720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 138/270] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:21.108505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac42e9-aa2f-49e9-b800-2e9975275dde None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.108879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac42e9-aa2f-49e9-b800-2e9975275dde None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.109177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac42e9-aa2f-49e9-b800-2e9975275dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.127440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-33ac42e9-aa2f-49e9-b800-2e9975275dde None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:21.128710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-33ac42e9-aa2f-49e9-b800-2e9975275dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:21.198507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:21.206947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 133/271] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:21.209363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0c02-c462-4898-93ea-00f78b1d1965 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.209749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0c02-c462-4898-93ea-00f78b1d1965 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.210229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0c02-c462-4898-93ea-00f78b1d1965 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.211741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 139/272] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:21.218619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.219156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.221069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.232437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0c02-c462-4898-93ea-00f78b1d1965 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.247411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:21.248972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:21.336341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 134/273] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:21.359997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.369558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0c02-c462-4898-93ea-00f78b1d1965 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.424437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.425272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.425555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.425829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.443885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:21.452069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:21.453854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:21.454832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:21.457250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 140/274] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:21.463138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.499028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53d61-bb79-42a2-b1e0-f7d5b557110c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.528943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:21.530666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:21.545591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.547118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.547480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.549003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.560279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:21.569867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:21.570872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:21.571765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:21.574581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 135/275] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:21.581190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.584531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60872be-49c4-4849-bb0c-7cfe59eb5801 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.629382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.630626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.631113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.631592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.632710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:21.633645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:21.635594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:21.648487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 141/276] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:21.655412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.705877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b769a2c-1218-47b4-a490-85315f0499c5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.749868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.750676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.750949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.751213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.752154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:21.752755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:21.754143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a00a8-bc3b-45b2-bbfb-864bf7f3bc41 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:21.763266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 136/277] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:21.767767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0687d-17a8-425c-8334-9e453e7131ee None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.768917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f57c9-a046-4067-b3bd-6807cea3c391 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.769212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f57c9-a046-4067-b3bd-6807cea3c391 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.769488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f57c9-a046-4067-b3bd-6807cea3c391 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.770815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 137/278] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:21.771434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f57c9-a046-4067-b3bd-6807cea3c391 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.793726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:21.807713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.809167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.809457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.809805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] PATH_INFO: `/v3/users/1ed1b1729a814a2187a13af247043040` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.824010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:21.825061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] RBAC: Authorizing `identity:get_user(user_id=1ed1b1729a814a2187a13af247043040)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:21.827280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c4471-c468-4a11-8ce6-e647fdb0f4ae None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:21.830235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 142/279] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/users/1ed1b1729a814a2187a13af247043040 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:21.831649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.831943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.832226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.849532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:21.850726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:21.891582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f57c9-a046-4067-b3bd-6807cea3c391 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:21.930390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 143/280] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:21.935911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:21.941668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:21.943375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:21.943922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:21.944887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] PATH_INFO: `/v3/users/5e8bda70568e4c6d90b49e991772d7ae` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:21.946989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8bda70568e4c6d90b49e991772d7ae)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:21.948923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:21.951514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 138/281] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/users/5e8bda70568e4c6d90b49e991772d7ae => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:21.957450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.037936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e51bd-1d5b-4ccf-b50a-b5f85c6636be None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.047318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.058386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738bfa-de27-407a-aef1-42807824bba5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.072733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.073382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.073667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.073945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.076112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, user.id=1ed1b1729a814a2187a13af247043040, scope.system=all) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:22.076112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.076316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.076524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.081446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 144/282] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/role_assignments?user.id=1ed1b1729a814a2187a13af247043040&scope.system=all&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:22.082216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.094106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.095069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.095356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.095669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.096984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.098520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439564e-0576-4ade-8ccb-0f00b82b823b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.100558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 139/283] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:21 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:22.101861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f55cd-92bd-4371-92f7-220275af2feb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.102125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f55cd-92bd-4371-92f7-220275af2feb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.102409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f55cd-92bd-4371-92f7-220275af2feb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.104101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 140/284] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:22.106110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f55cd-92bd-4371-92f7-220275af2feb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.223974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaef19-b168-4128-ad35-2a86bd32c6a5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.225842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f55cd-92bd-4371-92f7-220275af2feb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.263592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.263810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.264410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.264673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.265494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.265591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.265846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/5e8bda70568e4c6d90b49e991772d7ae/roles/d50edcbdf493472bb150805a53ba2120` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.266723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.268184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, user_id=5e8bda70568e4c6d90b49e991772d7ae, role_id=d50edcbdf493472bb150805a53ba2120)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.268284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0fa6c-5e50-4a30-8fa1-7bb0ea9c1afb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.269623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.269864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 145/285] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:22.274430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.274430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.274430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.290160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:22.291349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:22.326050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.342058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 141/286] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:49:22 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/users/5e8bda70568e4c6d90b49e991772d7ae/roles/d50edcbdf493472bb150805a53ba2120 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:49:22.348479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.362574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 146/287] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:22.387965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.413096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.486994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe90ca-e5f2-44c0-9dd7-e3e56694c47c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.506360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399b212-73ec-4cea-98fe-57298cd0eb87 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.532782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.535472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.535985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.536453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.537414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.539156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.549168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.551199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.551199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.551199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.563111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:22.570875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:22.571907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:22.572900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 147/288] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:22.581493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.615805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.643234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 142/289] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:22 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:22.699484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a10025-0e91-4ba8-9d94-f2a4fa65db29 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.743119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.744198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.744793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.745276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.746255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:22.746821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.748478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.759742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 148/290] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:22.768028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:22.878350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:22.881182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498e96f-d0e7-4762-8e2e-abaab150cfe9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:22.930191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:22.931076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:22.931355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:22.931651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] PATH_INFO: `/v3/users/33d9248cf7ec4da48d189b6137d3b30f` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:22.933041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] RBAC: Authorizing `identity:get_user(user_id=33d9248cf7ec4da48d189b6137d3b30f)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:22.934468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:22.936444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 143/291] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:22 2022] GET /identity/v3/users/33d9248cf7ec4da48d189b6137d3b30f => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:22.942014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:23.042549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:23.051723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf495-559b-4eca-b170-d5e5cb04d5b9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:23.087123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:23.087965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:23.088380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:23.088755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:23.162867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:23.164545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:23.282989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 149/292] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:23.287585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:23.289033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:23.435011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ea5a-d300-48c3-a1e9-d4985ef0cc70 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:23.483224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:23.487558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:23.487558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:23.487558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:23.487558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:23.488292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a7c42-33f2-4084-a7a4-deec22dedb9e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:23.490173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 144/293] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:23 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:23.498188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:23.683869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31367-21d1-46de-a5fb-e387f754498e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:23.752516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:23.753533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:23.754038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:23.754516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:23.755929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=33d9248cf7ec4da48d189b6137d3b30f) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:23.756455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:23.758120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007a527-f379-463e-8c98-3c333eab9a05 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:23.770255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 150/294] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:23 2022] GET /identity/v3/role_assignments?user.id=33d9248cf7ec4da48d189b6137d3b30f&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:24.765015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb807-0de7-42db-b114-51e8f25af65b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:24.765626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb807-0de7-42db-b114-51e8f25af65b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:24.765626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb807-0de7-42db-b114-51e8f25af65b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:24.767249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 145/295] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:24.772862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28626ad-ddbd-45ab-9cee-ef81d2e5ce2b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:24.773288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28626ad-ddbd-45ab-9cee-ef81d2e5ce2b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:24.773478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28626ad-ddbd-45ab-9cee-ef81d2e5ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:24.791195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b28626ad-ddbd-45ab-9cee-ef81d2e5ce2b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:24.792402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b28626ad-ddbd-45ab-9cee-ef81d2e5ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:24.847060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:24.861003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 151/296] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:24.884055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb807-0de7-42db-b114-51e8f25af65b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:24.930854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.003767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb807-0de7-42db-b114-51e8f25af65b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.034089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e7df-8f81-488d-8369-cfa2eb44e4cc None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.034381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e7df-8f81-488d-8369-cfa2eb44e4cc None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.034579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e7df-8f81-488d-8369-cfa2eb44e4cc None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.036140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 152/297] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:49:25.041526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.041917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.042209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.042936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a91812-d21f-4825-b743-f78424744341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.043762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91812-d21f-4825-b743-f78424744341 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.044045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91812-d21f-4825-b743-f78424744341 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.044318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91812-d21f-4825-b743-f78424744341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.057228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a91812-d21f-4825-b743-f78424744341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:25.059231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:25.060442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-64a91812-d21f-4825-b743-f78424744341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:25.067303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:25.068283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:25.069099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:25.069739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 146/298] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:25.074462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a91812-d21f-4825-b743-f78424744341 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.195610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 153/299] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:25.222666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.228652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.235298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a91812-d21f-4825-b743-f78424744341 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.271187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.272349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.272858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.273381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.274506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:25.275042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:25.276732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:25.287777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 147/300] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:25.294202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.349799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ceb009-8984-4a35-bf81-a00df814db11 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.375917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.397069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.398544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.399345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.402204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.411751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:25.419337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:25.420272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:25.421647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 154/301] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:25.427987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd27b-3ca3-40be-8ec5-471a09266a81 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.428718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.472388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.473578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.473873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.474413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] PATH_INFO: `/v3/users/1ed1b1729a814a2187a13af247043040` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.475712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed1b1729a814a2187a13af247043040)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:25.477963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:25.485529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 148/302] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/users/1ed1b1729a814a2187a13af247043040 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:25.487037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.524456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.535056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b95f-2104-4f9f-929d-3a6897c1555b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.570796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.571553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.571954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.572332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.573179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:25.573584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:25.575065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:25.588314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 155/303] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:25.589331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.619983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277d94-05ae-47df-ba3a-2d014e4258e5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.631116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.659397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.660292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.660572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.660844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] PATH_INFO: `/v3/system/users/1ed1b1729a814a2187a13af247043040/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.662302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ed1b1729a814a2187a13af247043040, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:25.663725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d59dd-da63-4362-8c65-f1c15374b0c5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:25.694614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06755a-dcae-4887-91d8-ef8615a56bdb None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.728119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.728983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.729288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.729565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] PATH_INFO: `/v3/users/5e8bda70568e4c6d90b49e991772d7ae` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.730746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8bda70568e4c6d90b49e991772d7ae)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:25.732202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94b21b-9f2a-44b5-ba18-61e318d73067 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:25.734108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 156/304] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/users/5e8bda70568e4c6d90b49e991772d7ae => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:25.735455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3f55-34c0-471c-947b-e766f083ac1a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.735770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3f55-34c0-471c-947b-e766f083ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.736051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3f55-34c0-471c-947b-e766f083ac1a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.737260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 157/305] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:25.738593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045a6c-4b50-4fc3-a112-d1a0cb1a2bbf None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.738800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045a6c-4b50-4fc3-a112-d1a0cb1a2bbf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.739078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045a6c-4b50-4fc3-a112-d1a0cb1a2bbf None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.740437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 158/306] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:25.741466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045a6c-4b50-4fc3-a112-d1a0cb1a2bbf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:25.770698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 149/307] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Jun 6 12:49:25 2022] PUT /identity/v3/system/users/1ed1b1729a814a2187a13af247043040/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:49:25.772598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf0ea-67b1-499c-b000-c0a2539d6196 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.773050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf0ea-67b1-499c-b000-c0a2539d6196 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.773331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf0ea-67b1-499c-b000-c0a2539d6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.792614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-624bf0ea-67b1-499c-b000-c0a2539d6196 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:25.793864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-624bf0ea-67b1-499c-b000-c0a2539d6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:25.860769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045a6c-4b50-4fc3-a112-d1a0cb1a2bbf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:25.876130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.876882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 150/308] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:25.878212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.878506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.878786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.905687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:25.907192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:25.918825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:25.920216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:25.920623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:25.921423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:25.924732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:25.991430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 151/309] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:25.992458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.000178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.001939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.096582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0032f-3ada-403d-85e5-ec3c3bfc0438 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.116305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 159/310] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:26.121507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.130684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.132184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.132984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.133266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.133530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.144937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:26.152780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:26.153714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:26.154532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 152/311] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:26.155402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.168188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.241097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e8ace-af6c-43b4-b583-3bfa7f787b9a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.263211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24b7-7cf5-4848-b7ec-d35ce4bf4f92 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.279010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.279849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.280655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.281205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.282443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.283913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.285546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 160/312] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:26.286310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.301694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.303150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.303872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.304323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.306111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.307743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.310307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 153/313] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:26.312103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.371651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.398840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.399865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077bc2-51aa-4b0b-8091-4d85991b8180 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.420638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fb2ce-0add-4f50-8b2f-7da41eaba11b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.436047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.436798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.437276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.437567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.438324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:26.438638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.440041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.448862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 161/314] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:26.449667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.462239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.462909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.463200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.463475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] PATH_INFO: `/v3/groups` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.464203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.465636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.539595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 154/315] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Jun 6 12:49:26 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:26.552612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.555162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ce9-ace1-4d6e-92a5-604b0fb0bff4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.597310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.598002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.598291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.598574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.600309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, scope.project.id=5ed61d1131a840df983eccf0e323cd04, user.id=5e8bda70568e4c6d90b49e991772d7ae) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:26.600634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.602452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.607519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.612817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 162/316] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/role_assignments?user.id=5e8bda70568e4c6d90b49e991772d7ae&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=d50edcbdf493472bb150805a53ba2120 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:26.713002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d865ea-5e07-4ecc-ab37-6cf2afcea94e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.756853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.757765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.758054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.758334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] PATH_INFO: `/v3/users/7379e22461fc4465a2ef35ac9183ff1b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.769633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:26.777499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] RBAC: Authorizing `identity:get_user(user_id=7379e22461fc4465a2ef35ac9183ff1b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.779081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe7de-d03f-4509-b63e-1858593c4d3f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.782307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 155/317] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/users/7379e22461fc4465a2ef35ac9183ff1b => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:26.788234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:26.907355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9018-72c4-41f4-b23a-8a244b3f1802 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:26.950650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:26.951317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:26.951639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:26.952442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:26.953943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, user.id=7379e22461fc4465a2ef35ac9183ff1b, scope.system=all) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:26.954279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:26.955804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a7ea-dffb-4c85-bfda-fed345ea41d7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:26.962048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 163/318] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 6 12:49:26 2022] GET /identity/v3/role_assignments?user.id=7379e22461fc4465a2ef35ac9183ff1b&scope.system=all&role.id=d50edcbdf493472bb150805a53ba2120 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:28.082454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42b3b-76da-49d8-b1c6-cc58c1d4c536 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.082960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42b3b-76da-49d8-b1c6-cc58c1d4c536 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.083035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42b3b-76da-49d8-b1c6-cc58c1d4c536 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.084441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 156/319] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:28.089667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.090074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.090248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.108629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:28.110142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:28.173224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:28.181428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 164/320] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:28.208359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42b3b-76da-49d8-b1c6-cc58c1d4c536 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:28.319027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42b3b-76da-49d8-b1c6-cc58c1d4c536 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:28.353318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:28.354109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.354397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.354676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.365653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:28.373393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:28.374430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:28.375283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 157/321] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:28.381921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:28.485089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc56f5-9380-4aef-9bea-07d8f48cb1eb None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:28.520382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:28.521059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.521347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.521626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.522378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:28.522685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:28.524161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:28.533128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 165/322] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:28.538519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:28.598272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:28.646730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005443-a64f-45a8-ba75-6ce39700890e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:28.682218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:28.683416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.683907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.684325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] PATH_INFO: `/v3/users/1ed1b1729a814a2187a13af247043040` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.685660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] RBAC: Authorizing `identity:get_user(user_id=1ed1b1729a814a2187a13af247043040)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:28.687304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c92c-459b-4be5-a727-13f78bf25fbf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:28.689399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 158/323] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:28 2022] GET /identity/v3/users/1ed1b1729a814a2187a13af247043040 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:28.695011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:28.755719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:28.802996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff7fe-e01e-499f-981d-e7a54e02f227 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:28.839126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:28.839891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.840187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.840469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.841381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] RBAC: Adding query filter params (role.id=79fc4f0825474a51ad5377681ccd06cf, user.id=1ed1b1729a814a2187a13af247043040, scope.system=all) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:28.841705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:28.843287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0dd35-7092-42a9-85db-ecb7eb1eb4d7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:28.862781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 166/324] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 6 12:49:28 2022] GET /identity/v3/role_assignments?user.id=1ed1b1729a814a2187a13af247043040&scope.system=all&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:28.935014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e684-41eb-4f7e-be86-7e6732bab97b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.935333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e684-41eb-4f7e-be86-7e6732bab97b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.935611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e684-41eb-4f7e-be86-7e6732bab97b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.937667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 159/325] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:28.943481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596344-abe8-47ec-b0f1-9cc3966c3409 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:28.943805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596344-abe8-47ec-b0f1-9cc3966c3409 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:28.944084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596344-abe8-47ec-b0f1-9cc3966c3409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:28.961743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4e596344-abe8-47ec-b0f1-9cc3966c3409 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:28.962972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4e596344-abe8-47ec-b0f1-9cc3966c3409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:29.035834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 167/326] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:29.058930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e684-41eb-4f7e-be86-7e6732bab97b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.169795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dcc1-e95e-43fb-bd2f-7e39dcb7e34d None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.170303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dcc1-e95e-43fb-bd2f-7e39dcb7e34d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.170464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0dcc1-e95e-43fb-bd2f-7e39dcb7e34d None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.172403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 168/327] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:49:29.177383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.177676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.177957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.195120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:29.196326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:29.224591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e684-41eb-4f7e-be86-7e6732bab97b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.238285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:29.248137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:29.259474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.260328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.260614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.260895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.262055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:29.263511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:29.264318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 169/328] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:29.265967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 160/329] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:29.271587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.287073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.374934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d232d1-5a86-4d7c-ac87-86450e7ba9ae None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.388730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4da56-8ddc-424b-b2ef-8b617963327a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.409550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.410211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.410497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.410775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] PATH_INFO: `/v3/groups` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.411462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:29.413084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:29.422899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.423717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.424003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.424279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.434131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:29.441950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:29.442989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:29.443849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 161/330] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:29.448842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.495464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 170/331] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Jun 6 12:49:29 2022] POST /identity/v3/groups => generated 226 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:49:29.501091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:29.553881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5cc3-42db-4d87-8ed7-1490ec60b5e3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.591358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.592072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.593188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.593299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.594432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:29.594748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:29.596203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:29.605486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 162/332] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:29.612668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.649466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:29.721013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c0639-3cda-4000-bf10-ef02aa44c395 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.755489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.756389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.756675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.756954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] PATH_INFO: `/v3/users/7379e22461fc4465a2ef35ac9183ff1b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.758185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] RBAC: Authorizing `identity:get_user(user_id=7379e22461fc4465a2ef35ac9183ff1b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:29.759664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8364c-afbd-45fd-bf77-e29f4fdf4d2c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:29.761476 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 171/333] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:29 2022] GET /identity/v3/users/7379e22461fc4465a2ef35ac9183ff1b => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:29.767661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:29.876250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6f56-a45d-4717-8993-5e571d86cde0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:29.891418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:29.918712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:29.920235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:29.921257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:29.921741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] PATH_INFO: `/v3/system/users/7379e22461fc4465a2ef35ac9183ff1b/roles/d50edcbdf493472bb150805a53ba2120` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:29.923963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7379e22461fc4465a2ef35ac9183ff1b, role_id=d50edcbdf493472bb150805a53ba2120)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:29.925806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541af279-3eb4-40af-a840-fd0a2477c03c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:29.998101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 163/334] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Jun 6 12:49:29 2022] PUT /identity/v3/system/users/7379e22461fc4465a2ef35ac9183ff1b/roles/d50edcbdf493472bb150805a53ba2120 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:49:32.038462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1c9a-db0a-497a-a358-230c3e3290ae None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.039506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1c9a-db0a-497a-a358-230c3e3290ae None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.040051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1c9a-db0a-497a-a358-230c3e3290ae None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.041647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 172/335] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:32.047895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000331c3-e333-482a-a8d0-11c0f49512ac None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.048765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000331c3-e333-482a-a8d0-11c0f49512ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.049260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000331c3-e333-482a-a8d0-11c0f49512ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.077075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-000331c3-e333-482a-a8d0-11c0f49512ac None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:32.091092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-000331c3-e333-482a-a8d0-11c0f49512ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:32.259323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 164/336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:32.298570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc1c9a-db0a-497a-a358-230c3e3290ae None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:32.313254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c87701-3f8b-4c20-a682-70c40d8ea485 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.315154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c87701-3f8b-4c20-a682-70c40d8ea485 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.315700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c87701-3f8b-4c20-a682-70c40d8ea485 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.317365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 165/337] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:32.323701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.326109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.327891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.360578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:32.363620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:32.486230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 166/338] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:32.521311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc1c9a-db0a-497a-a358-230c3e3290ae None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:32.523456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:32.524874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:32.596593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:32.598086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:32.598904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.599191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.599469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.621001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:32.633689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:32.634663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:32.635551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 173/339] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:32.650283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:32.676201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de0e6d-4a3b-496c-9631-f368d826e36f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:32.719059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:32.720021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.720312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.720596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.731907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:32.745430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:32.746389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:32.747208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 167/340] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:32.755704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:32.862615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7fc70-400b-475a-b305-da3123454caa None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:32.877954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54d7e-4e3f-4a99-b07b-e861b345318a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:32.899889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:32.915708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:32.920783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:32.932013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 168/341] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:32.938188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:32.938522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:32.939209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:32.939497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:32.939799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:32.940565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:32.940878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:32.942274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:32.956236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 174/342] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:32.966980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.006651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.086421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37cb57-4802-4f96-8b0b-c68fa1327490 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.148803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.149464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.149915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.150194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.157542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e2ac7-f284-4e66-8848-14dad0cdbd8d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.185251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.217593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.218862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.220184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.220714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.241724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:33.243191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66dcb2-b3d5-4b2a-8e54-f7c0241c8bf8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:33.303170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:33.305017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded59641-8a6a-446d-aa89-07b014513b57 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:33.340802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.401269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 169/343] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 12:49:33.402938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f6fb-b444-4463-976a-6c48ed1883cc None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.404439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f6fb-b444-4463-976a-6c48ed1883cc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.405099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f6fb-b444-4463-976a-6c48ed1883cc None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.408007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 170/344] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:33.409103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f6fb-b444-4463-976a-6c48ed1883cc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.490437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 175/345] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 12:49:33.492201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.492656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.493074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.500558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.521746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:33.523163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:33.559341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f6fb-b444-4463-976a-6c48ed1883cc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.605993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.606871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.607162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.607455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.609848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:33.618947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:33.625628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 171/346] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:33 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:33.626550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.669023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 176/347] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:33.669995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.747832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.758417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0cb6-91b4-40b1-82ca-133d03611b0f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.787873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:33.798061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.799277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.799763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.800210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.801595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:33.803213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e46f6f-a517-4e41-aecc-a64ef0a02baa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:33.805315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 172/348] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:33 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:33.806716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070082dc-f829-485b-9684-fd5baae03d51 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.807189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070082dc-f829-485b-9684-fd5baae03d51 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.807672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070082dc-f829-485b-9684-fd5baae03d51 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.808601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bb8e-6e88-4f84-8aca-1adb8ab7de52 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.809324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 173/349] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:33.810923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070082dc-f829-485b-9684-fd5baae03d51 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.852819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.854478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.854770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.855054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.864376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:33.865858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:33.867894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 177/350] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:33 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:33.868594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:33.934720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070082dc-f829-485b-9684-fd5baae03d51 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:33.976475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:33.977663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:33.978145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:33.978634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:33.990505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ecfc2ecd-9259-4392-8c0b-87bf50f45c80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:33.998580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:33.999584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 12:49:34.000426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:34.001069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb2fc1-b557-480b-a74f-9b1270de6b20 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.002929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 174/351] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:34.004377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.004865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.005365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.021520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.023007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:34.024454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:34.039334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.040239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.040569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.044758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.044758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.044758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.046235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 178/352] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:33 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.047382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.084876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.101894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 175/353] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:34.103447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.163153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650126de-6b7b-4b23-8716-0b61e38cda6f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.199594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.200188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.200477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.200758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.202232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:34.202807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.204396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.210354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 179/354] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=69292b9b6bc94583adb5935816723fd8 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.211173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.218679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534e4ba-1130-48df-8a43-bb31f319f574 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.258074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.259159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.259689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.260186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.261176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:34.261695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.263333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.273642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 176/355] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.274280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.275099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.334694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.336041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220b75-245b-4adb-9514-1a237c779638 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.382567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.383257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.383578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.383867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.384738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:34.385125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.386691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9afd-6cff-4ceb-adbe-0b0b88046a0d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.396387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 180/356] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.397747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111afcd-cd38-4d69-a772-9c96b191c64b None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.398046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111afcd-cd38-4d69-a772-9c96b191c64b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.398331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111afcd-cd38-4d69-a772-9c96b191c64b None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.401205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ea4e-6dad-46dd-b6a5-c2a595a1cb5c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.401354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 181/357] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:34.402165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111afcd-cd38-4d69-a772-9c96b191c64b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.457680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.458595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.458984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.459367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.480266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-733aa4ae-4e21-4cae-81d7-c70673c1446a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:34.488484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:34.489683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:34.490723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 177/358] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:34.494653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715178e-0e1e-4db4-9cd3-569e8462abbb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.495078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715178e-0e1e-4db4-9cd3-569e8462abbb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.495460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715178e-0e1e-4db4-9cd3-569e8462abbb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.497917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 178/359] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:34.500115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac609-4e09-4eba-bdc5-265c875cf166 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.500525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac609-4e09-4eba-bdc5-265c875cf166 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.500902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac609-4e09-4eba-bdc5-265c875cf166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.525631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-12fac609-4e09-4eba-bdc5-265c875cf166 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:34.527284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-12fac609-4e09-4eba-bdc5-265c875cf166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:34.552276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111afcd-cd38-4d69-a772-9c96b191c64b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.568853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.592684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.593532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.593815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.594096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] PATH_INFO: `/v3/users/7379e22461fc4465a2ef35ac9183ff1b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.595425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] RBAC: Authorizing `identity:get_user(user_id=7379e22461fc4465a2ef35ac9183ff1b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.596956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.603618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 182/360] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/users/7379e22461fc4465a2ef35ac9183ff1b => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.604679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.615432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 179/361] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:34.617106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.617569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.618004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.638012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:34.640967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:34.679949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.733514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 180/362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:34.734986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.768024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6d50-b4fe-4958-b365-923a2f6f5286 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.816032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.817377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.817950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.818479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.819374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:34.819902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.822265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.833680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 183/363] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.834747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.878262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7607cb-ea7b-42aa-8af7-499fa9b9d7df None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:34.915913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:34.932623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:34.933455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:34.934005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:34.956771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:34.956771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] RBAC: Adding query filter params (role.id=d50edcbdf493472bb150805a53ba2120, user.id=7379e22461fc4465a2ef35ac9183ff1b, scope.system=all) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:34.956771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:34.956771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:34.956771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 181/364] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/role_assignments?user.id=7379e22461fc4465a2ef35ac9183ff1b&scope.system=all&role.id=d50edcbdf493472bb150805a53ba2120 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:34.957162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:34.986041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4dfa7-d44f-490d-9763-b6ee96da75b4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.021332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.066711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.068060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.068585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.069077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.084120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:35.093903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:35.094907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:35.096683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:35.099309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 184/365] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:35.100581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.191496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e2b2-bb28-4499-a17d-4391e528d0b4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.234832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.236424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.236424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.236424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.250230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:35.257469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65e7e3-fe46-4f89-b218-1a3301c91d36 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:35.257968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:35.258812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:35.260132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 182/366] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:35.261028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.264545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.306471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.308061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.308564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.309050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.365759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.385018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd031-ae3b-473c-85a4-49273c8844f0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.406352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:35.408664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:35.429533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.431972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.432264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.432544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.433295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:35.433606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:35.434981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:35.445831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 183/367] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:35.448417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.548815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 185/368] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:35.549676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.553706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.568396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143d25e-5235-4744-b5d0-34e20be169b8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.604387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.605437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.606316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.606803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.609281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:35.610011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:35.611712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:35.623887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 184/369] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:35.625558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.671936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.700185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c5e7-e70a-4576-8e00-b0e5ef296be0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.745927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.747091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.747930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.749290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.760905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3587-58bb-470a-a7ee-d497a70b17d1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.805627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:35.807352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:35.807868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:35.808785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:35.810627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:35.812696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:35.815711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 185/370] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:35.817293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:35.843344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:35.844788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:35.848350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.931991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:35.955225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd91e4-262c-47d8-9c55-6ed6121a002f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:35.985849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 186/371] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:35.986701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.008088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.008749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.009043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.009331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.096077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.097532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.102895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9cf3e-c51a-4506-ba33-764e31d739f2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.105336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.140269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.141137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.141423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.141698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.142883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.144417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.146070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 187/372] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.146922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.187936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.204658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 186/373] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:36.205513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.254755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db42b-b580-4138-9b1b-b4d90c27512d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.293407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.294283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.294574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.294852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.296413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.297855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.299601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 188/374] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.304357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.315577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649504-4b74-4cb7-933e-0271e6f6d2f2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.353417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.358630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.359340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.359650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.359924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.360762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=5ed61d1131a840df983eccf0e323cd04) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:36.361070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.362652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.370183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 187/375] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.371254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.442335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9094-efa8-47b6-8bf2-2947e0faba01 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.447902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.494471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df6b9-8af1-4249-b99e-96d593d23151 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.509729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.510612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.510901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.511183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] PATH_INFO: `/v3/projects/16ba10bd5fa94006bd8ba1520b916555` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.512410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] RBAC: Authorizing `identity:get_project(project_id=16ba10bd5fa94006bd8ba1520b916555)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.513912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.515678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 189/376] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/projects/16ba10bd5fa94006bd8ba1520b916555 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.524306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.564325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.565561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.566066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.566572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.568424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.570203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.572267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.592875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.667051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de488a-530f-4440-81a7-07a5295458aa None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.681875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.724601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.725485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.725774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.726049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] PATH_INFO: `/v3/groups/124e35fa33494373bd8f2be110d754b9` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.731313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] RBAC: Authorizing `identity:get_group(group_id=124e35fa33494373bd8f2be110d754b9)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.732976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.735729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 190/378] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/groups/124e35fa33494373bd8f2be110d754b9 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:36.741246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:36.745521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8dd57-6e87-4b8f-b4e8-6a3e7da52126 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.774002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:36.801857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.803022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.803414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.803751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.806284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5ed61d1131a840df983eccf0e323cd04) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:36.806284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.806622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1a90-fc4b-4163-8b66-2ad6e467d06d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.819627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 189/379] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=69292b9b6bc94583adb5935816723fd8 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:36.873467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50683807-d6f3-434a-867f-cea4d1cb3381 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:36.913789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:36.913789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:36.913789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:36.913789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:36.914191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] RBAC: Adding query filter params (group.id=124e35fa33494373bd8f2be110d754b9, role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=16ba10bd5fa94006bd8ba1520b916555) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:36.914191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:36.915836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19761ebd-efed-4b51-8ce4-98040c22e7e5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:36.922842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 191/380] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:36 2022] GET /identity/v3/role_assignments?group.id=124e35fa33494373bd8f2be110d754b9&scope.project.id=16ba10bd5fa94006bd8ba1520b916555&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:37.065306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5691-e124-47ae-bd57-94e579d7b78b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.065762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5691-e124-47ae-bd57-94e579d7b78b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.066340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5691-e124-47ae-bd57-94e579d7b78b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.068005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 190/381] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:37.078633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.079266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.079769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.109213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:37.110953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:37.151088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:37.190329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792382-d280-4319-9615-eb3b718be067 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.190511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792382-d280-4319-9615-eb3b718be067 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.190796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792382-d280-4319-9615-eb3b718be067 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.192411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 191/382] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:37.199494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.200084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.200188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 192/383] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:37.200265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.221322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:37.223369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:37.226115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.318801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 192/384] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:37.347663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.362121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8f3a-cefa-4e45-82e9-d13509bec4e5 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:37.405824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:37.406669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.407029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.407305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.434691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:37.445443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:37.446564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:37.447612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:37.451915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:37.465928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.517295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:37.557382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82a56-ec85-4b43-bfce-86012c17bfdf None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:37.563139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:37.628327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:37.629156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.629426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.629698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.645805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050db111-7d84-4720-ac0a-8017c19591b9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:37.657961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:37.674057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:37.675089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:37.676896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:37.683893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.695327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:37.701178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.701459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.701734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.702509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:37.702817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:37.704281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:37.720276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 194/387] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:37.726039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.824440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cc55b-780b-45b4-8670-918bc66a3a5e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:37.880240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:37.880924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.881208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.881482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.882239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:37.882551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:37.883984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:37.912302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 194/388] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:37.919703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:37.926543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:37.946233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388df6be-68e1-4d20-a165-ff587a6bc6b7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:37.975075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:37.985512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:37.991857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 195/389] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:37.996653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:38.057838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deb264-ebb5-4757-a9d6-361acdc9e619 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:38.097456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:38.098326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:38.098616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:38.098892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:38.100121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:38.101568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:38.103493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 195/390] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:38.110933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:38.127497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b895-0636-4884-9e44-418bd98bb16f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:38.189081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:38.189962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:38.190245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:38.190521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:38.193184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:38.194658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:38.199573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 196/391] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:37 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:38.205580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:38.248478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:38.251865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:38.258574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f7b85-a505-407a-a28b-880f724778c3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:38.311564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:38.312533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:38.312824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:38.313102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:38.314332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:38.315835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:38.317838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 196/392] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:38 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:38.323759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:38.409302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f270e-101d-4332-8c83-b33ff6a70d4c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:38.457486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:38.460981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:38.461274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:38.461551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/groups/95f6976f77ff480db81264a586d043dc/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:38.464440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, group_id=95f6976f77ff480db81264a586d043dc, role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:38.466052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ed891-2f4c-429f-9f16-661a92091752 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:38.490131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5c20-c0a0-4c6c-b5c0-ae6a23223d00 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:38.534583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:38.535871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:38.536420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:38.537002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/groups/95f6976f77ff480db81264a586d043dc/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:38.539939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d154a88e50f4b9c8868d9237ae1680a, group_id=95f6976f77ff480db81264a586d043dc, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:38.541785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b387f0-8f93-4b23-9a03-a66b393ac25e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:38.554804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 197/393] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 6 12:49:38 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/groups/95f6976f77ff480db81264a586d043dc/roles/69292b9b6bc94583adb5935816723fd8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:49:38.654233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 197/394] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 6 12:49:38 2022] PUT /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a/groups/95f6976f77ff480db81264a586d043dc/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:39.433064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea13b-adda-455b-8862-61dc8af0a260 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:39.434106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea13b-adda-455b-8862-61dc8af0a260 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:39.434610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea13b-adda-455b-8862-61dc8af0a260 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:39.436620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 198/395] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:39.442400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:39.443228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:39.443754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:39.465817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:39.467693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:39.490358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:39.562012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:39.597110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ea13b-adda-455b-8862-61dc8af0a260 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:39.717998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:39.735775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ea13b-adda-455b-8862-61dc8af0a260 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:39.783894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:39.785527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:39.785527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:39.785527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:39.802163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-39a8d947-92b6-4a52-a055-dddc3e4246e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:39.810062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:39.811572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:39.812491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:39.817807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:39.847268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c1a5-38a7-40a3-85f5-2fa7cc6e4cf2 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:39.847603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c1a5-38a7-40a3-85f5-2fa7cc6e4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:39.847802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c1a5-38a7-40a3-85f5-2fa7cc6e4cf2 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:39.849175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 200/398] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:49:39.855387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:39.855737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:39.856025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:39.884398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:39.885614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:39.987511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f897-4ddc-4c6b-8fe0-cbfce438ebef None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.000752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 201/399] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:40.025250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.026330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.026912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.027418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.028455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:40.029539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.031560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.034879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.055933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 199/400] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:40.060889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.093826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.180635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.208902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2677ed-9a11-4a34-9386-8607440c4023 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.226219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9260-715d-4e40-bf6a-fd9d8e5f2b7e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.247387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.248489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.248851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.249142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.260705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:40.261697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.262557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.262841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.263116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.264905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.266357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d99c58f8-a9ee-40e5-8851-8dc2c11fdf98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:40.269755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:40.270634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:40.271439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 202/402] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:40.272604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28006f0-a713-4ba7-af8d-36faa9c5594c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.272697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 200/402] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:40.272776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28006f0-a713-4ba7-af8d-36faa9c5594c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.274029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28006f0-a713-4ba7-af8d-36faa9c5594c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.274141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.275483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 203/403] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:40.279637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28006f0-a713-4ba7-af8d-36faa9c5594c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.374707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.398534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19163e-56da-4583-a175-b1053e3cdce0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.398899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28006f0-a713-4ba7-af8d-36faa9c5594c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.440798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.441427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.441812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.442101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.442383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.442741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.443172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.443608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.444017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.444926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:40.445037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b57a06-89da-417c-91bf-46dc9cc55ae2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.445470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.447030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.448699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.451609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 201/404] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:40.453106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.453400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.454779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.463824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 204/405] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:40.465219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.472917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:40.474146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:40.548378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 202/406] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:40.549149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.590213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95894fff-287f-45a7-8a1d-083cc3b2fad4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.634535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.636340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.636886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.637502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/groups/95f6976f77ff480db81264a586d043dc/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.640737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, group_id=95f6976f77ff480db81264a586d043dc, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.642546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.659112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.678917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e926-9981-49e6-a6e8-7f60e33382a3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.712717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.713631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.713917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.714226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.715486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:40.717484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:40.723676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 203/407] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:40.723676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.767666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 205/408] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 6 12:49:40 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/groups/95f6976f77ff480db81264a586d043dc/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:40.769048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.848402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05d33-872e-4ab8-b1cd-ff13cf4189ad None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.891256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:40.892137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:40.892420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:40.895559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:40.910592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:40.937405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:40.945332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:40.946308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:40.947162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:40.954768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 204/409] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:40.963342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:40.987897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a1177-6597-428f-91b0-77e7ee9dba5e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:40.995952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:41.034059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.034953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.035419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.036113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.037525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.039007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.041869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 206/410] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:41.047783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.136967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ddd1-18de-4bcf-91bb-d4f04e96f28b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.174552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.175643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.176128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.176601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.177044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94805d-9c5f-48b4-a012-e67d6087bc8a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.177755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:41.178289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.180043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.194224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 205/411] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:41.195832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.204305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:41.216429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.223812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.224179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.224458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04/groups/95f6976f77ff480db81264a586d043dc/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.227230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] RBAC: Authorizing `identity:create_grant(project_id=5ed61d1131a840df983eccf0e323cd04, group_id=95f6976f77ff480db81264a586d043dc, role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.228747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390df06d-9b24-4d21-ae94-8d692d0f596c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.273238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:41.310271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 207/412] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 6 12:49:41 2022] PUT /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04/groups/95f6976f77ff480db81264a586d043dc/roles/69292b9b6bc94583adb5935816723fd8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:41.317637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf229dd-92c0-4242-bd38-c4fc85a13f1a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.355741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c5898-fa98-4aa3-88ec-fc2144594cda None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.356138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c5898-fa98-4aa3-88ec-fc2144594cda None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.356534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c5898-fa98-4aa3-88ec-fc2144594cda None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.358491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 208/413] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:41.364118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.364441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.364688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.367472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.368364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.368646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.368917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] PATH_INFO: `/v3/groups/124e35fa33494373bd8f2be110d754b9` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.370249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] RBAC: Authorizing `identity:get_group(group_id=124e35fa33494373bd8f2be110d754b9)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.371866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.378727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 206/414] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:41 2022] GET /identity/v3/groups/124e35fa33494373bd8f2be110d754b9 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:41.380038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.388236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:41.389598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:41.521080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 209/415] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:41.549212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.584836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0274-77f0-4da8-8cac-260f5aa8f737 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.629193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.630168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.630457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.630731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] PATH_INFO: `/v3/projects/16ba10bd5fa94006bd8ba1520b916555` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.632072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] RBAC: Authorizing `identity:get_project(project_id=16ba10bd5fa94006bd8ba1520b916555)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.633507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6097d6-026b-40f9-96a7-295b20aad05b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.635725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 207/416] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:41 2022] GET /identity/v3/projects/16ba10bd5fa94006bd8ba1520b916555 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:41.637009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76d0be-bcb4-4d11-aa2f-5fd212f61f2e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.637290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76d0be-bcb4-4d11-aa2f-5fd212f61f2e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.637561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76d0be-bcb4-4d11-aa2f-5fd212f61f2e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.639473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 208/417] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:41.642708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76d0be-bcb4-4d11-aa2f-5fd212f61f2e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.654899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:41.699101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94c91d-db53-431e-aa12-59acb9fa6621 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.718493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:41.744406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.745698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.746446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.747172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.756912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76d0be-bcb4-4d11-aa2f-5fd212f61f2e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:41.760942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-33964808-6cdc-4303-8243-499f6fa5ad15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:41.771388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:41.775119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 210/418] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:41.776076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.777100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.777100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.797550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:41.799512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:41.801646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:41.802807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:41.803280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:41.803805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] PATH_INFO: `/v3/projects/16ba10bd5fa94006bd8ba1520b916555/groups/124e35fa33494373bd8f2be110d754b9/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:41.805982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] RBAC: Authorizing `identity:create_grant(project_id=16ba10bd5fa94006bd8ba1520b916555, group_id=124e35fa33494373bd8f2be110d754b9, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:41.807683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:41.875900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 209/419] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 6 12:49:41 2022] PUT /identity/v3/projects/16ba10bd5fa94006bd8ba1520b916555/groups/124e35fa33494373bd8f2be110d754b9/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:49:41.877820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:41.884062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 211/420] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:41.926774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.003993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:42.045192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9c9d-0bfb-40b9-8f9c-7380f848ab57 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.084782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.085857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.086382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.087220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.088190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:42.088670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:42.091990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:42.100965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 210/421] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:42.108660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.144574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aafff-845c-4b2d-aff1-ea69fed8eb28 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.147011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:42.181979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.182678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.182961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.183246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.198687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:42.207019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:42.207979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:42.208815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:42.210034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 212/422] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:42.217275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.239141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50860c-977c-4d34-9f86-7a6e6ed71f93 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.299910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:42.320367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.321216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.321532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.321811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.334974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259f646-d9a7-4510-8258-cf2ed26e5495 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.413247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.413933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.414223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.414503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.415270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:42.415604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:42.417066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:42.426403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:42.426638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 213/423] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:42.428178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:42.432107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.492916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:42.539994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 211/424] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:42.545928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.603890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:42.662896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcad594-0267-4f39-93cc-4ee0c381d4e3 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.717816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.718532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.718829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.719111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.757239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fea23-63a9-464d-86bc-b668ba3d8b31 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:42.803618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:42.804492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:42.804778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:42.805054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:42.806844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:42.808377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:42.810731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 212/425] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:42 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:42.815801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:42.855216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:42.856922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:42.889293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:43.006234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 214/426] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 12:49:43.012325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:43.039890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:43.043675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d5bd2-042a-4df7-9445-e91df3a5acc0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.129547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.130435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.130730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.131009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.132397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:43.134036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:43.136226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 213/427] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:42 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:43.147434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:43.167486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9920-ee80-49ae-8ef7-85418ebb7593 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.210933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:43.230894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.231890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.232175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.232614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] PATH_INFO: `/v3/projects/3d154a88e50f4b9c8868d9237ae1680a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.234094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] RBAC: Authorizing `identity:get_project(project_id=3d154a88e50f4b9c8868d9237ae1680a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:43.235557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:43.238525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 215/428] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/projects/3d154a88e50f4b9c8868d9237ae1680a => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:43.243551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:43.346236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ccbd-3623-49e8-9e56-3547f3129f67 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.417050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.417713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.418000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.418278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.419110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:43.419483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:43.420955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:43.430149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89f7b1-b36a-40a7-9df0-930bd70bc638 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.436300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 214/429] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=69292b9b6bc94583adb5935816723fd8 => generated 611 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:43.479012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.479953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.480240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.480532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.481812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:43.483559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382793-decd-4e60-a0bb-1e5ed3fce6eb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:43.485520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 216/430] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:43.492680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:43.533556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:43.594489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787eeb-8eab-4bfa-8c3e-0cee84652441 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.594813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787eeb-8eab-4bfa-8c3e-0cee84652441 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.595064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18787eeb-8eab-4bfa-8c3e-0cee84652441 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.599377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 217/431] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:49:43.604894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.605186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.605474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.616864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb766bd-2a89-439e-90a3-e29da079faff None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.640862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:43.642119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:43.758869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:43.771407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 218/432] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:43.784326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.785000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.785288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.785569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.786469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=3d154a88e50f4b9c8868d9237ae1680a) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:43.786790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:43.788270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:43.796298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 215/433] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=3d154a88e50f4b9c8868d9237ae1680a&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:43.807938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:43.928920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7fbb-e550-4845-baae-e340237a2cce None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:43.968835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:43.969646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:43.969933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:43.970210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:43.983221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1f6a61a5-8e14-41e2-ba5b-11adbf361ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:43.991282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:43.992308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:43.993131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 219/434] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:44.000405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.105724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.116423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2efda-f354-4139-bbe2-f82ee967f486 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.159707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.160312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.160610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.160891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.161656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] RBAC: Adding query filter params (name=member) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:44.161967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:44.163377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:44.173311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8dcaa-c4a6-4822-bf9a-52f1f91b0dbf None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.173600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8dcaa-c4a6-4822-bf9a-52f1f91b0dbf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.173877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8dcaa-c4a6-4822-bf9a-52f1f91b0dbf None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.174545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 216/435] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:44.176664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 220/436] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:44.179964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.182324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.182628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.183070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.204762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:44.206108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:44.262355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.299591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 221/437] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:44.307023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30755-2fbf-4cf7-a71b-af6d0e0f347b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.319705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.347900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.348929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.349216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.349492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.383144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.440449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:44.441827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea36e-b304-4451-a57d-65a1e56d6461 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:44.446758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5e4c-3995-476a-a1e6-74894cbf763c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.497824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.498632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.498916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.499191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.512279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f90b2b03-416d-4319-91e3-ac755cdc6e97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:44.521381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:44.522317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 222/438] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:44.523930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec9a6-4dff-42b7-a575-d3a37a50ce62 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.524704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec9a6-4dff-42b7-a575-d3a37a50ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.524704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec9a6-4dff-42b7-a575-d3a37a50ce62 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.525759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 223/439] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:44.531200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bec9a6-4dff-42b7-a575-d3a37a50ce62 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.569402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 217/440] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:44.570686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d632-18bf-410b-b097-979d9459c38e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.570973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d632-18bf-410b-b097-979d9459c38e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.571248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d632-18bf-410b-b097-979d9459c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.585769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.588818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f220d632-18bf-410b-b097-979d9459c38e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:44.590020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f220d632-18bf-410b-b097-979d9459c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:44.642421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.647423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bec9a6-4dff-42b7-a575-d3a37a50ce62 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.660537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 218/441] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:44.661393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220d632-18bf-410b-b097-979d9459c38e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.688042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.688712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.689004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.689261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.690002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:44.690306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:44.691760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:44.699517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 224/442] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:44.700307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.763914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220d632-18bf-410b-b097-979d9459c38e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.797560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.798518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.798867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.799145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.800337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:44.801472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03ed9-0d15-486e-8e69-5ea71368c164 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.801899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:44.803405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 219/443] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:44.804191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.808811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.837169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.837958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.838244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.838516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.849823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:44.855985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:44.857517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:44.858635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 225/444] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:44.859489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:44.911611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6dbd5-1777-4560-879f-e05295ef923d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.943913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.944482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.944768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.945042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.962920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5870e-b9e1-4c86-b2d6-a28ba48a5363 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:44.995839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:44.996689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:44.996980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:44.998648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:44.999897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.001356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.002966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 226/445] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.004581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.014403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.015887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.040830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.067700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.112046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214858d3-a5ce-4d8c-bf6f-6656760e4b05 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.116935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 220/446] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:45.117769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.148872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.149547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.149833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.150111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.150854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:45.151164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.152564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.161288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 227/447] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.162001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.222313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6b88-ceb8-4789-91dc-41c1298f5acd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.254888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.255623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.256279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.256563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.256842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.257691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=79fc4f0825474a51ad5377681ccd06cf, scope.project.id=5ed61d1131a840df983eccf0e323cd04) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:45.258005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.259488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.264782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7c8d-12e7-4550-8ab2-bd1a5c30589b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.265427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 221/448] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=79fc4f0825474a51ad5377681ccd06cf => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.266315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.297334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.302103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.302993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.303275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.303567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] PATH_INFO: `/v3/projects/5ed61d1131a840df983eccf0e323cd04` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.304892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] RBAC: Authorizing `identity:get_project(project_id=5ed61d1131a840df983eccf0e323cd04)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.306380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.310833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 228/449] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/projects/5ed61d1131a840df983eccf0e323cd04 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.314112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.395517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc2e6-c61a-43a1-8468-33b9828668f6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.424575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26b93-25e2-4d52-bea1-21ef6cfdc024 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.434730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.435624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.435913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.436193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.469647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.470522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.470817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.471103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] PATH_INFO: `/v3/groups/95f6976f77ff480db81264a586d043dc` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.472597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] RBAC: Authorizing `identity:get_group(group_id=95f6976f77ff480db81264a586d043dc)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.473762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.475382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 229/450] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/groups/95f6976f77ff480db81264a586d043dc => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:45.481717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.516837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.519990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.522846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.546297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.648848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 222/451] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:45.655343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.720478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ab09-7407-4d39-8096-e377a9d136a0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.754869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.755808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.756098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.756372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.757197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] RBAC: Adding query filter params (group.id=95f6976f77ff480db81264a586d043dc, role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5ed61d1131a840df983eccf0e323cd04) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:45.757510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.758950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.762174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285e9e-f068-44c4-9891-4a99c08a777e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.764807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 230/452] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/role_assignments?group.id=95f6976f77ff480db81264a586d043dc&scope.project.id=5ed61d1131a840df983eccf0e323cd04&role.id=69292b9b6bc94583adb5935816723fd8 => generated 611 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.779409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.799263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.800177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.800458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.800728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] PATH_INFO: `/v3/projects/16ba10bd5fa94006bd8ba1520b916555` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.801963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] RBAC: Authorizing `identity:get_project(project_id=16ba10bd5fa94006bd8ba1520b916555)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.803418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.805254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 223/453] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/projects/16ba10bd5fa94006bd8ba1520b916555 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:45.811113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:45.912379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:45.918825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa419f3-f47e-4f75-800d-a92b992a7810 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:45.954370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:45.955242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:45.955550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:45.955840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] PATH_INFO: `/v3/groups/124e35fa33494373bd8f2be110d754b9` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:45.957032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] RBAC: Authorizing `identity:get_group(group_id=124e35fa33494373bd8f2be110d754b9)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:45.958473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b3f29-ea6a-4136-b724-b74c71dc019c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:45.960118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 231/454] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/groups/124e35fa33494373bd8f2be110d754b9 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:45.966543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:46.069359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac489-43c1-46b4-ad45-c30f4c6c37d4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:46.103796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:46.104508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:46.104796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:46.105074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:46.105915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] RBAC: Adding query filter params (group.id=124e35fa33494373bd8f2be110d754b9, role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=16ba10bd5fa94006bd8ba1520b916555) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:46.106227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:46.108741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ccea-f854-41f0-a5c4-9a6bdc502939 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:46.114828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 224/455] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 6 12:49:45 2022] GET /identity/v3/role_assignments?group.id=124e35fa33494373bd8f2be110d754b9&scope.project.id=16ba10bd5fa94006bd8ba1520b916555&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:48.711143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1baf38-78f7-47c9-9403-d2c7c4731e42 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:48.711682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1baf38-78f7-47c9-9403-d2c7c4731e42 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:48.711760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1baf38-78f7-47c9-9403-d2c7c4731e42 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:48.713306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 232/456] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:48.719508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946285bb-3c39-4c72-a93e-3721c419349a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:48.719938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946285bb-3c39-4c72-a93e-3721c419349a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:48.720109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946285bb-3c39-4c72-a93e-3721c419349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:48.741709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-946285bb-3c39-4c72-a93e-3721c419349a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:48.742917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-946285bb-3c39-4c72-a93e-3721c419349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:48.797531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:48.832254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 225/457] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:48.868667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1baf38-78f7-47c9-9403-d2c7c4731e42 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.004090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3481b-8f5a-4fc8-8f16-d53d93eb409b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.004315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3481b-8f5a-4fc8-8f16-d53d93eb409b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.004877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3481b-8f5a-4fc8-8f16-d53d93eb409b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.006854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 226/458] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:49.012089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.012794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.013297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.041989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:49.044062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:49.052396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1baf38-78f7-47c9-9403-d2c7c4731e42 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.115071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.115904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.116271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.116550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.137412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.139663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:49.166306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:49.167442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:49.168552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:49.168552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:49.168552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.168552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:49.171329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 233/459] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:49.177218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.186371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 227/460] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:49.196171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:49.210920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.315625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923c579-6fd7-4b8a-8b9d-e3997394aa30 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.361596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.364024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.364481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.365187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.366688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:49.370569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.372947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c14b7f-401a-47c8-ac8a-2670c51931cc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.386963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 234/461] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:49.388841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d450-d57c-4e19-99bf-e82445ab3e86 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.389135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d450-d57c-4e19-99bf-e82445ab3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.389418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d450-d57c-4e19-99bf-e82445ab3e86 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.394998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 235/462] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:49.395844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d450-d57c-4e19-99bf-e82445ab3e86 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.404413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca421d-ea07-4287-ba23-8d4db3e63512 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.415066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:49.442758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.443996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.444550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.445053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.458780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.460784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.479546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c60396d6-653b-4184-9906-dbfdadbfe860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:49.480952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:49.481944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:49.482815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:49.482815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:49.482815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.482815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:49.485051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 228/463] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:49.486490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.487006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.487575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.505893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:49.507433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:49.513560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d450-d57c-4e19-99bf-e82445ab3e86 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.556007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.556676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.556959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.557233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.557939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.560818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.593523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 229/464] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:49.593523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.683621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:49.689211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 236/465] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:49 2022] POST /identity/v3/users => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:49.690033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.706070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192ea02-18bf-429a-81b2-fcf81887da28 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.748633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.749499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.749668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.749958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.750861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:49.751179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.752691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17da11-d1d6-40f6-be78-6bdb17069903 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.767613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 230/466] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:49.769172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ed6d-d849-4f14-ae3f-79a0ba7f3f0e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.769949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ed6d-d849-4f14-ae3f-79a0ba7f3f0e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.769949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ed6d-d849-4f14-ae3f-79a0ba7f3f0e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.771141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 231/467] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:49.776375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ed6d-d849-4f14-ae3f-79a0ba7f3f0e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:49.838388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476e00c-bdb7-4201-916f-e1de2f97c867 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.883554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:49.893366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.896365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.896365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.896365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.903054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ed6d-d849-4f14-ae3f-79a0ba7f3f0e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:49.912377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.916470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-6fb01ca8-e836-445c-9f68-b0c3babd30ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:49.938369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:49.944365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 237/468] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.945229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.957861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:49.958859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:49.959147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:49.959426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:49.960272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:49.961705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:49.962860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:49.964357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:50.038642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 232/469] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:49 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:50.039783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.047725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 238/470] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:50.051736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:50.069387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.184475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce17e-14ce-48d1-a963-554c67647e75 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.237523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.238595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.238595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.238868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.240845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:50.240845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.242777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.250922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fdd74-1c5f-49ad-8460-33d3ac7ce96f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.264982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 233/471] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:50.271958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.288061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:50.317009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.318346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.319128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.320053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.333378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.335629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:50.359799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:50.360726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:50.361597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:50.361597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:50.361597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:50.361597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:50.364162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 239/472] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:50.374079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:50.375513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.419282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de19be-f942-4d14-b9d4-8b55df4db6cc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.470315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.470919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.471208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.471486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.472315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.474430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413c88f-1bf8-43e1-aa3a-e660e73a90d7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.504560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9183bd-88de-476b-aa19-8775953bf776 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.542296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.543028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.543796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.544080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.544804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:50.545176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.546533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39f79f-d630-4d7b-a9cd-5c5dfb254b42 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.558266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 240/473] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:50.561416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00ea-4444-4d22-af32-933f01d5b157 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.561416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00ea-4444-4d22-af32-933f01d5b157 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.561416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00ea-4444-4d22-af32-933f01d5b157 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.562326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 241/474] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:50.564246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a00ea-4444-4d22-af32-933f01d5b157 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.587769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 234/475] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:50 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:50.589713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.592072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.594262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.597969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:50.635540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:50.636788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:50.749633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 235/476] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:50.783894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a00ea-4444-4d22-af32-933f01d5b157 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.798107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:50.855882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.857935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.858717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.859614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.860569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.862754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:50.863212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.921308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda121d-556b-4269-9299-46e0aed879b8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:50.956948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:50.957620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:50.957908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:50.958190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:50.959046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:50.960421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:50.986136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 242/477] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:50 2022] POST /identity/v3/users => generated 249 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:51.021446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.sql.core [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 12:49:51.021446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 06 12:49:51.021446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [parameters: {'id': '53a99f9801a0448bb94a663cb0c94eea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 06 12:49:51.021446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80341) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application result.read() Jun 06 12:49:51.040782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return ref.to_dict() Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:49:51.041738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application yield resource Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise self.value Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application session.commit() Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 12:49:51.042685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self.session.flush() Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application compat.raise_( Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 12:49:51.043633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:49:51.044572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application result.read() Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:49:51.045418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [parameters: {'id': '53a99f9801a0448bb94a663cb0c94eea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:51.046232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 06 12:49:51.047057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:51.049938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 236/478] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 6 12:49:50 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:51.051296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:51.252095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:51.274635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03726-6a47-44de-b608-b8d5dc318935 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:51.320867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:51.321685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:51.321966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:51.322238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:51.345817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-8743aafd-b3c2-47b5-8cb5-60a0eb245071 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:51.353968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:51.354910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:51.355781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 243/479] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:51.362995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:51.493439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58617-d8f0-45d3-98ac-10b7e46d935b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:51.517545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:51.541258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:51.541865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:51.542146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:51.542418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:51.543165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:51.543467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:51.545458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6ddea-7ee1-4257-b7ea-0783cca62b2d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:51.560755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 237/480] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:52.257999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f83f4-3a53-4e1e-8bbe-ae35c750bf78 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:52.258487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f83f4-3a53-4e1e-8bbe-ae35c750bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:52.258487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f83f4-3a53-4e1e-8bbe-ae35c750bf78 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:52.260072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 244/481] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:52.265993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:52.266415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:52.266589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:52.292485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:52.294200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:52.382146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 238/482] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:52.413959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f83f4-3a53-4e1e-8bbe-ae35c750bf78 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:52.577809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f83f4-3a53-4e1e-8bbe-ae35c750bf78 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:52.627931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:52.629138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:52.629632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:52.630133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:52.644142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:52.648248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:52.657585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:52.658539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:52.659453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:52.662247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 245/483] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:52.668702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:52.830143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85dd7-25ed-4302-9f81-459f8f52bae0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:52.845549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:52.875050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:52.875752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:52.876089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:52.876371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:52.877121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:52.877426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:52.878801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa406c0-53a4-4e1e-bb7f-6baf03ac97b5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:52.894100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 239/484] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:52.899555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.063511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e91499-955d-40e2-8d77-ec59376c379c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.100667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.101805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.102286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.102757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.114935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:53.116742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:53.125167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b141-1487-46f5-8d41-736d0d19cc5a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.125458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b141-1487-46f5-8d41-736d0d19cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.125737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4b141-1487-46f5-8d41-736d0d19cc5a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.127266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 240/485] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:53.132706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.133002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.133290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:53.140712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:53.141580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:53.142638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:53.142638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:53.142638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:53.142638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:53.142638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 246/486] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:53.147257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.167456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:53.169228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:53.206395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:53.271933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebbc5b-96f8-4b57-987d-26d08dc59277 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.325186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 241/487] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:53.340739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.341658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.342123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.342560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.343431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:53.343925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:53.345448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:53.358978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 247/488] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:53.364101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.378163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.480365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:53.484208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2e017-3d2a-474a-a089-3e8df807ae81 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.487250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d25b8f-afe8-4a35-9e9d-0e68f2c2892e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.501284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:53.521602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.522557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.528425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.528425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.528718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.528824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.528912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.528912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.533429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:53.535082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:53.535470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-ff81251b-4379-462e-a04b-3fbcca9f7cb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:53.543194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:53.544393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:53.545274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:53.546098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 248/489] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:53.547082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69be60-d5ff-493c-b209-6826b7fc9ff6 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.547370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69be60-d5ff-493c-b209-6826b7fc9ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.547674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69be60-d5ff-493c-b209-6826b7fc9ff6 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.553066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 249/490] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:53.553845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69be60-d5ff-493c-b209-6826b7fc9ff6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-268703c3-22a3-4de6-a2dd-c1c148dfa6f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:49:53.557747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:53.558689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:49:53.560547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:53.563117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 242/491] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:53.564763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.565257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.565736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.584264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:53.585917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:53.660227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 243/492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:53.661534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.677122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69be60-d5ff-493c-b209-6826b7fc9ff6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.713274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.713942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.714226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.714500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.715303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:53.715663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:53.717340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:53.725757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 250/493] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:53.726511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.761526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:53.775920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:53.784093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491013-71c0-4f1e-a949-7801820b9274 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.826973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.827691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.828024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.828294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.829127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:53.829433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:53.831090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:53.844252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaefb-2617-489c-bc0d-95efecf19ea4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:53.880209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 244/494] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:53.881188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.882292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:53.883337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:53.884183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:53.885612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:53.900263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:53.911902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:53.912964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:53.913800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:53.915601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 251/495] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:53.916611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:53.997715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101bd96-be6c-46fc-96ad-81c39a76fb78 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.028750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.034430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.035233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.035599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.035765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd0a5-23ad-424f-bfc9-3a8cca4f5c6a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.035861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.046357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.047839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.056471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:54.066439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:54.067308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:54.068239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:54.068239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:54.068239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.068239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:54.068239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 245/496] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:54.068516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.076763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.077560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.077847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.078126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.153483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.155550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.179823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c96bc-fb65-4e73-b51f-186199ec9969 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.218935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.219722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.219951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.220229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.221190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:54.221297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.222723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12507359-e6d7-4ac3-b0da-cc3b0b82e0b0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.232567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 246/497] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:54.238734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ba12e-c980-4676-a57f-00d4c05cf287 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.239027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ba12e-c980-4676-a57f-00d4c05cf287 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.239642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ba12e-c980-4676-a57f-00d4c05cf287 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.243662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 247/498] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:54.243662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ba12e-c980-4676-a57f-00d4c05cf287 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.264685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.272350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 252/499] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:54.277565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.317425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.359643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ba12e-c980-4676-a57f-00d4c05cf287 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.378613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c47b-3fcf-42e1-a2d2-7c30be8bc6f6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.396183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.396846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.397133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.397411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.398135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:54.398443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.399834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cbd42-8298-4883-872b-ce40ce0975c6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.417167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 248/500] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:54.418497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.419029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.419387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.421616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.422525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.422806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.423082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.435717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.436217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:54.437144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.437455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:54.460113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:54.461005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:54.461943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:54.461943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:54.461943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.461943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:54.461943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 253/501] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:54.467369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.514297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 249/502] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:54.515608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.524913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.578772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.585315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308205b-b559-4fa5-9790-374ac5c1d03e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.618680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.619474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.619844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.620128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.625434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d9d7a-54e6-4848-ad3b-7acdfaf425b0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.630847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.632322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:54.649415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:54.650450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:54.651392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:54.651392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:54.651392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:54.651392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:54.651392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 254/503] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:54.651941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.660641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.661426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.661708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.661986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.669507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.670953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:49:54.685659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:54.686604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:54.687602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 250/504] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:54.688187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.755029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.758899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21868-b30d-4e5a-9d95-9c225a15988d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.786520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c21-0e99-43db-aca7-347753f9532f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.794008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.794660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.794951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.795230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.795979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:54.796286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.797648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea955e6a-9e70-4f0d-99c0-df83863dffa2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.799546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:54.808551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 255/505] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:54.810324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5888-e954-4756-bd2f-8ece941fc143 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.810690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5888-e954-4756-bd2f-8ece941fc143 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.813668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5888-e954-4756-bd2f-8ece941fc143 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.813668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 256/506] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:54.813668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae5888-e954-4756-bd2f-8ece941fc143 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.822743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.823638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.823928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.824214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.836257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:54.844467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:54.845574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 251/507] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:54.846412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.921447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae5888-e954-4756-bd2f-8ece941fc143 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.945077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4ed0-e29f-4be0-a153-36acdfeece6f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:54.954715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.955378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.955691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.955970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.956687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:54.956997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.958364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.969861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 257/508] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:54.970647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:54.982659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:54.983349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:54.983662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:54.983936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:54.984773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:54.985082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:54.986518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab783f-6e79-44a9-9052-3788cf1b72c1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:54.989129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.004579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 252/509] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:55.005862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.006150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.006427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.022007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:55.023198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:55.047681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.069677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487fb7f-09e3-447d-bc9f-ef34ae0ccb30 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.090768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 253/510] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:55.091886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.106800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.107724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.108012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.108289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.116984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.119671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:49:55.133961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:55.134896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:55.135844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 258/511] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:49:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:55.136455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.192500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8dc35-2851-4f40-a15c-4f085f7d6bce None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.218148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.226358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.227019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.231288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.231288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.231288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:55.231288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.231288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.239163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 254/512] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:55.239488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e40a5-2bfe-4040-ba09-43b920c1585b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.240006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.265700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.273800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.274588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.277697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.277697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.282454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.283926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:49:55.298971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:55.299960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 259/513] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:55.301374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.343641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989ea1-08ee-4966-8dfc-7bfd3dc03a69 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.377495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.378135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.378417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.378687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.398259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452d45-2b7a-426c-8089-8fe671d3443d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.431189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.432000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.432284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.432561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.439269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.443837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.444753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.445284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.446335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:55.462582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:55.463509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:55.464434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:55.464434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:55.464434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.464434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:55.464434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 260/514] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:55.464711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.473452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.547954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 255/515] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:55.548796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.570157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94707b4-4925-4ffd-9d08-a7888415e30a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.603317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.604014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.604304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.604586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.605420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:55.605762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.607309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.643498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 261/516] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:55.644364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.649157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c34be4-22da-4a77-960b-313c0ee8877b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.671868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.683206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.684597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.684893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.685137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.693545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.695233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:55.713670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:55.714777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 256/517] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:55.716105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.751407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a735fe-fd5c-458f-84c4-2855ef27c0a2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.785588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.786238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.786521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.786794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.787596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:55.787895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.789319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.806674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 262/518] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:55.807486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.818157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fd1-4f5e-4b82-863e-244fdfce1b94 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.851258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.851953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.852241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.852516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.853230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:55.853536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.854903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.867056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 257/519] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:55.867891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:55.901069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.907305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07d0aa-81f4-4d92-b537-afc9b1e7a017 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.919811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:55.943969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:55.944763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:55.945048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:55.945331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:55.956140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:55.957591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:55.968741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce11bee-a8e2-4473-aaba-ed17263dabeb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:55.975422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:55.976452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:55.977342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:55.977342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:55.977342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:55.977342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:55.977342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 263/520] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:55.977617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.006441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.007010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.007289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.007597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.073464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.075043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.076660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4456e-c4ed-44d7-9047-d08e00745ebc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.107209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.110098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.110752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.111035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.111308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.112056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:56.112360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.113710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.126563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 264/521] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:56.127357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.148270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.174530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 258/522] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:56.175350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.227506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be061bb-2ca6-4bca-a7be-496023cacf21 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.263656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.264237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.264523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.264796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.265623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:56.265943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.267368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.272794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 265/523] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:56.273558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.274026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59195c29-5b44-4f34-8eed-6651f1cdabbd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.319136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.319858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.320140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.320413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.321122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.322579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.330411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.368891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.386663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacf5c0-69ec-4294-b3e7-48a495eea0d9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.423928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.424606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.424893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.425172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.425897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:56.426206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.427599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.441133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 266/524] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:56.442085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.479886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 259/525] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:49:56 2022] POST /identity/v3/users => generated 247 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:49:56.480807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.573305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33a82f-d788-4aac-a81a-5e43c0f6fd39 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.613285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06955-8187-465e-9d0a-7d189485c8e3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.615555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.616701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.617139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.617563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.627848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.629655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:49:56.646906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:56.648202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:49:56.649326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:56.656246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 267/526] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:56.656895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.658980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.659844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.660123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.660493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.661651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.674884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.676112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:56.695618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:56.696787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 260/527] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:56.697853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.756986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.794858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6280-9d17-4072-9278-1ea1e0d580bf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.830742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.831454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.831783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.832058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.833819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fded7-18c0-4618-9472-a1634e2786af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:56.839379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.841085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:49:56.859061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:56.860201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:56.861299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:56.863548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 268/528] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:56.864484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.884755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:56.885946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:56.886381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:56.887382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:56.889046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:56.889509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:56.891214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:56.916086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 261/529] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:56.923124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:56.945958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:56.988763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085dfad-a553-46c8-8798-04a52d10a047 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.033584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.034252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.034539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.034818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.036028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.036341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.038001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.051608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.052657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 269/530] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:57.053632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.055190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083772-8fbf-42ba-b005-4221d8acb6d8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.102073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.103139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.103729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.103729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.104544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.104841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.107600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.132539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 262/531] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:57.132539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.184914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3ac7-ee9e-4c91-b56d-4f60e6c23bd8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.210806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.227810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.228993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.229433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.229856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.250775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ab1ee-bf82-4bec-b837-b7f0df785a95 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.287369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.288354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.288732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.289103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.296950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.298625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:49:57.314567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:57.315651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:57.316739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:57.318384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.320015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.323680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 263/532] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:57.324084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.348424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.439957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53ac3-0ad6-4d25-bd35-bbf7fe8f922d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.451606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 270/533] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:49:57.453088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.484609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.486986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.488282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.488574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.489569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.490406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c8839b9c0fca4cffb2bae93393cb7db7) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.490721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.492274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.499448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 264/534] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/role_assignments?user.id=c8839b9c0fca4cffb2bae93393cb7db7&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:57.499801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.575937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0bd43-93c8-4e94-a2aa-18a29bf19228 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.616811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.617972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.618510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.619002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.620046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.620675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.622510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.637555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 271/535] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:57.643696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.664859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.692334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c04dca-73a8-4582-94bb-dcbd899599df None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.740580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:57.758467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0310df-bd12-44cc-869b-7b257670d7be None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.783196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.784092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.784382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.784660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.796906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.798421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.801100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.802000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.802480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.802970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.804029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=d74ba06aac5c41fb84b55297050305ad) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.804542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.806141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:57.812949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 272/536] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/role_assignments?user.id=d74ba06aac5c41fb84b55297050305ad&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:49:57.818530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:57.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:57.820337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:49:57.820337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:49:57.820337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:49:57.820337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:57.820337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 265/537] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:57.825623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:57.945896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7c6a-85c5-41fb-83a8-2be886d7063c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:57.985246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:57.986385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:57.986877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:57.987413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:57.988385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:57.988975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:57.990671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:58.010151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 273/538] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:58.010752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:58.140567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aba4-3940-4205-b57e-0c04cf7c4492 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:58.183170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:58.184575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:58.185013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:58.185291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:58.188181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:58.196359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:58.197761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:49:58.216117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:58.217060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:58.218033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 266/539] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:49:58.224613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:58.239079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:58.351553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8117f-2617-4906-9045-943253d31bc0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:58.390865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:58.391552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:58.391842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:58.392122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:58.392905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:58.393214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:58.394645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5378-f535-46b2-83f3-6c7d2ae7b83f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:58.415785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 274/540] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:58.422134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:58.600665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa69f-5118-4a6d-a890-5908dc95c494 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:58.659680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:58.660703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:58.661190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:58.661692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:58.662719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=a9a0512f3f084ca791825b70b0d1c6b8) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:58.663232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:58.664878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf5ed-2e38-4c9d-8048-125936b61f21 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:58.675811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 267/541] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:49:58 2022] GET /identity/v3/role_assignments?user.id=a9a0512f3f084ca791825b70b0d1c6b8&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:58.991707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f48ba3-2408-43ff-8151-4d0558b8f4f0 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:58.992247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f48ba3-2408-43ff-8151-4d0558b8f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:58.992247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f48ba3-2408-43ff-8151-4d0558b8f4f0 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:58.994468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 275/542] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:58.999264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4213ae-d2b3-4cf1-b998-b0182f59b3c2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:58.999858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4213ae-d2b3-4cf1-b998-b0182f59b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.000349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4213ae-d2b3-4cf1-b998-b0182f59b3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.020330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3e4213ae-d2b3-4cf1-b998-b0182f59b3c2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:59.021849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e4213ae-d2b3-4cf1-b998-b0182f59b3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:59.083449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:59.097031 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 268/543] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:49:59.131283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f48ba3-2408-43ff-8151-4d0558b8f4f0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.169071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa264f2-fbb3-4001-9d43-0bb66fc64f7c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.169670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa264f2-fbb3-4001-9d43-0bb66fc64f7c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.170156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa264f2-fbb3-4001-9d43-0bb66fc64f7c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.172212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 269/544] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:49:59.177152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.177449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.177734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.204889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:49:59.206105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:49:59.287378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:59.314982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 270/545] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:49:59.353436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.376773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f48ba3-2408-43ff-8151-4d0558b8f4f0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:59.464325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:59.465571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.465851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.466302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.474705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bdf1d-8309-4f68-a74a-2d58242c9145 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:59.499893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:59.500385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:59.512796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:59.513733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:49:59.515250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 276/546] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:59.524433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.525109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:59.526170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.526660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.527669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.552378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:49:59.567549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:49:59.568467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:49:59.569303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:49:59.572572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 271/547] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:49:59.578632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.643051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f25d-1499-4f6b-93dc-2e55f22b9fc0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:59.677415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:49:59.693754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:59.694516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.694777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.695063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.695844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:59.696165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:59.698868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:59.718462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 277/548] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:49:59.723625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.802891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5076-85d6-40cb-8830-7244961e9551 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:59.880920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b644ea-5cf6-460e-a7ff-f94e0a807ec7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:49:59.924192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:59.925243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.925678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.926105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.927004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:49:59.927481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:59.929359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:59.940235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 272/549] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:49:59.945081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:49:59.947913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:49:59.948631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:49:59.948971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:49:59.949804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:49:59.979264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:49:59.981001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:49:59.999954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:00.016315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:00.023872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 278/550] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:00.024792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.072145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2fb1-bc31-4a4d-89be-aed6cb1b945c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.118629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.119894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.122308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.122849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.131341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.138333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.140310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:00.162931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:00.165451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:00.166358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:00.166358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:00.166358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:00.166358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:00.167853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 273/551] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:00.174285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.272912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93dd71-e962-4795-885e-51735462bc4a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.342821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.343489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.343801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.344075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.344797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:00.345102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.346473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.356118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.364449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 279/552] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:00.369797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.377621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451814e-8286-4395-806d-d8e8170c7567 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.438561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.439324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.439641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.439917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.440650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:00.440937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.442505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a06728-f9cd-4b64-af6c-94aeabba23d5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.455943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 274/553] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:00.457408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ff20-7673-4618-a9ea-5949e3e345d2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.457700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ff20-7673-4618-a9ea-5949e3e345d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.457976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ff20-7673-4618-a9ea-5949e3e345d2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.459558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 275/554] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:00.464163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ff20-7673-4618-a9ea-5949e3e345d2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.482045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051cac-525a-4aa0-b0c6-9522b8c6ebfd None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.483755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.519072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.519897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.520183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.520460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.530330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.531730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-e10f2648-7188-43b2-ae95-605ce0e2c3bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:00.546040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:00.547043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:00.548047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:00.551605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 280/555] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:00.553239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238294-e0bc-405f-8c4e-dea760db2e55 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.553529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238294-e0bc-405f-8c4e-dea760db2e55 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.553900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238294-e0bc-405f-8c4e-dea760db2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.572346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f8238294-e0bc-405f-8c4e-dea760db2e55 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:00.573519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f8238294-e0bc-405f-8c4e-dea760db2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:00.589498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ff20-7673-4618-a9ea-5949e3e345d2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.628854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.629933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.630220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.630498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.638642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.640116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.648023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 281/556] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:00.649655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9e41-b24f-40a7-a6d8-26a1a2acc4f3 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.650085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9e41-b24f-40a7-a6d8-26a1a2acc4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.650494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9e41-b24f-40a7-a6d8-26a1a2acc4f3 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.652778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 282/557] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:00.653655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9e41-b24f-40a7-a6d8-26a1a2acc4f3 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-85dd2451-4dc9-4688-bd52-edcd752edd90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:00.659833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:00.660985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:00.662665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:00.665620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 276/558] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:00.666976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.667260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.667608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.684687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:00.685896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:00.696096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.758963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 277/559] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:00.759831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.772032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.782751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9e41-b24f-40a7-a6d8-26a1a2acc4f3 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.821940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.822618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.822910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.823186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.824665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:00.825209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.826501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.848874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 283/560] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:00.848874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.888656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5036ae3-abef-4c42-9195-2a6d198a1a5e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:00.931517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:00.932219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:00.932507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:00.932785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:00.934171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:00.934480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:00.935949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:00.954397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 278/561] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:00.955464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:00.958193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:00.963685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4392-085e-4b0b-9fe5-d4335b1a8acd None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.006829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.007660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.007949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.008448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.021101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:01.030220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.031254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:01.032158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 284/562] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.032927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.048554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.072963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2023d2-ed70-45e4-acb8-4b42c1564032 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.111046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.111873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.112158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.112540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.123943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:01.132945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.134366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 279/563] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.135243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.151387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2de3-402c-43e9-8ced-3b951d785da1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.188766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.189838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.190489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.190836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.202234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.203719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.203836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:01.222744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.223941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.225044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:01.225044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:01.225044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.225044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:01.230429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 285/564] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.230429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.252612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285e0e-3020-498a-b4c9-ccfec8ffc0af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.289942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.290512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.290783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.291057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.295256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.337492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5426d-fabf-4180-8a0b-dc5a397a0713 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.366544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.368140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.373182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.373845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.374134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.374411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.375165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:01.375474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.376863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.384847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:01.385634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.429845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.468802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 280/566] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:01.469630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.489147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1871e-dc9c-4dd3-9d36-64d5ea722177 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.512797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.523467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.559640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432185-3173-4c36-8fca-6bf56d25430e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 287/567] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a80-17a7-4607-ad80-663511783f74 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a80-17a7-4607-ad80-663511783f74 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a80-17a7-4607-ad80-663511783f74 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 288/568] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:01.560193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a8a80-17a7-4607-ad80-663511783f74 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.585021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447cfb2-352e-48fe-92a7-99d5f51b932f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.617713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.618376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.618661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.618938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.619688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:01.620001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.622098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.633127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 281/569] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:01.633911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.644729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a8a80-17a7-4607-ad80-663511783f74 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.658865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.677967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.678768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.679033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.679304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.689607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.691032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:01.707914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.709050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 289/570] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.710338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.734443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c0c3-86ad-41d8-83f9-7e60b58ac447 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.767161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.768082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.768368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.768642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.787157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.788630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-452fdbce-ec62-4df8-a2b4-4100b4ff1a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:01.806339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.807450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.809090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:01.809090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:01.809090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.809090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:01.809090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 282/571] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.809762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.809997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.810271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.819572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dd76d-9ecc-4d5b-a609-c03416ee04cc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:01.826449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:01.827654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:01.829140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.854610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:01.856106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:01.856394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:01.856668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:01.866987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:01.868453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:01.885740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:01.886907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 290/572] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:01.888175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.900741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 283/573] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:01.901586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:01.907032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.983911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:01.993598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dba39-ba4d-4006-b00f-fa3e59de767c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.004516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641b334-0924-4739-bd93-98b2c2a17d9d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.027788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.028810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.029101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.029662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.036284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.037726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.038693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202c455-f570-4857-94f2-98d142738756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.039344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c455-f570-4857-94f2-98d142738756 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.039661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c455-f570-4857-94f2-98d142738756 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.039937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202c455-f570-4857-94f2-98d142738756 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.040642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202c455-f570-4857-94f2-98d142738756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.040945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202c455-f570-4857-94f2-98d142738756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.042283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202c455-f570-4857-94f2-98d142738756 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:02.051595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:02.052665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 291/574] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:02.053628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.054710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 284/575] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.055712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202c455-f570-4857-94f2-98d142738756 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.118002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.154633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285cf58-8ab8-4eec-b88b-8d4175775614 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.154832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202c455-f570-4857-94f2-98d142738756 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.187660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.188313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.188432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.188596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.188872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.189131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.189418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.189576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.189696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.189881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.190453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.190766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.191230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.192161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.203082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 292/576] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.203912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.208126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 285/577] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.208591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.216488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.305504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e55c3-61aa-4630-861e-131a0934f2ed None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.306902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eac99-017d-49dd-a138-05574d0fd70e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.329151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.338954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.339901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.340291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.343655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.343759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.343759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.343759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.343759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.348509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.349948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.352604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:02.360267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:02.361454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:02.362418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 293/578] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:02.363222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:02.364267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:02.365173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:50:02.366271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:02.367668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 286/579] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:02.368711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.436052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.465892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94ee0-7d3c-4186-b3b1-a15dab75845c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.468904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3cc7-2088-4b22-aaaf-14bee8bb047a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.499171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.499976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.500259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.500532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.502240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.502910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.503191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.503469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.504282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.504594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.506056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.506982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.508438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.517848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 294/580] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.518689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:02.522364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:02.523426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:02.524419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 287/581] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:02.524928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.571303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.621942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386292c7-a818-406c-b340-0c2b8f13f38a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.625547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74937825-1298-4428-a74c-ff0bce036df1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.649451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.655885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.656676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.656958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.657233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.659418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.660101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.662374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.662374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.662374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.662374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.663020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.664525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.665938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.671131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 288/582] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.671956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:02.679911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:02.685663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 295/583] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:02.686823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.772716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efbb45-9af5-4dce-8401-dbc11824862c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.780220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.782509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6b9a-69d6-41b1-82e2-6fa5812aa4c6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.807496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.808214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.808493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.808763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.809584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.809892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.811305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.817012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.817892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.818173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.818448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.829008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 289/584] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:02.829819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.837508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=966c3cbce1b443fd9aae9c03cbe6a406, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.838964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:02.912793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 296/585] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:02 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:02.913614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:02.936469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44051c-7c03-47e6-8566-56efeec57e1c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:02.975099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:02.980348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:02.981047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:02.981331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:02.981607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:02.982413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:02.982726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:02.984258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.002885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 290/586] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.002885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.030617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.050947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acb283-7860-43c7-a5e4-a67043d6fe70 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.096088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.096894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.097176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.097451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.112493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.119473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.119631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58570-51b2-474e-adf2-6b675bcb8aaa None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:03.134066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:03.135195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:03.136467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:03.136467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:03.136467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.136467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:03.136467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 297/587] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:03.136820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.163144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.163922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.164402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.164678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.165634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.166048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.167831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.188432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 291/588] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:50:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.189547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.235819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.245132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288b71e-590c-492d-b93c-a60d7a8f545e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.280515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.284578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.285384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.285669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.285947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.297297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.298758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.299560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3d344-47b3-4f2a-bcb2-17de3a2d1e0e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:03.316914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:03.318088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 298/589] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:03.319102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.344174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.344983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.345275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.345559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.346369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=b2ec321b639b467595aa54be55e84956) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.346688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.348155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.353699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 292/590] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/role_assignments?user.id=b2ec321b639b467595aa54be55e84956&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.354493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.472589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f30e-ee25-4c15-980e-5e04a1934979 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.475971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e0df-5d0c-42a3-b980-91ac1b38d256 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.518344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.519547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.519547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.519973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.524712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.525624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.526068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.526532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.528351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.528843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.530680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.533759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.535209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.542635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.549174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 299/591] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.550376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:03.555220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:03.560049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:03.561257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:03.561257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:03.561257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:03.561257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:03.561539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.561628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:03.561628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.672030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20afe75-1713-4184-80d0-5f0dd6e1a702 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.689457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3d6a-68d4-4a2d-9c6e-7ec1ca83434e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.709786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.710587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.710874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.711152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.719742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.721208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.734954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.736038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:03.736150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:03.737094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:50:03.738103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:03.739460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.739983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.740932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.741446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.741826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 294/593] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:03.742659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.743636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.765728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 300/594] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.766907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.821332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.836232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:03.878803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2178-bee6-4a67-a68d-8bce4e531919 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.884639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7db52-aced-4fa3-821d-3f67099312d8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:03.920871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.921612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.921898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.922175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.923071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.923386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.924879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.935951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:03.936929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:03.937850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:03.938352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:03.939287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:03.939846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:03.941421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:03.948620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 301/595] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.949758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:03.954864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 295/596] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:03.955978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.055897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3639-3c65-4be7-bd95-c73f9d24430f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.063146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f9ac-44e4-407e-a0cf-8e606d7a2d00 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.083354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.084639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.095466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.109087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.109087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.109087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.109369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.109477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.109559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.109559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.109559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.109764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.117914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.119726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:04.121455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:04.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.123296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:04.127512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 302/597] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:04.128395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:04.143783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:04.144851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:04.145782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:04.145782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:04.145782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:04.145782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:04.148100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 296/598] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:04.149217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.241751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe810be-695e-46d2-bcea-9e19f76de56e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.255861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e2da-21ef-4124-a564-a091b13607e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.279478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.280301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.280586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.280859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.288253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.289917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.294816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.295763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.296257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.296758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.297755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:04.298280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.299947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:04.305303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:04.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:04.307264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 303/599] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:04.307784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.315941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 297/600] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:04.317040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.348284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.361520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.422296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05608-65db-4762-a437-86ade4502768 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.422979 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c23d5-19b5-4cd9-a712-d49e6c7eb6e7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.459459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.460557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.460882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.461221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.461508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.461785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.462107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.462498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:04.462792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.462906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.463908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:04.464216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.464778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.466441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.476948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 304/601] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:04.477838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.479201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 298/602] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:04.485122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.579707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.586490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2c93-ac10-46ce-878f-1e1eca651de2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.590768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:04.591046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535efc4-818c-445d-b2f4-a54b9c05068c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.627560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.628464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.628751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.629035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/d74ba06aac5c41fb84b55297050305ad/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.639451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.641192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.641690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.642301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.647654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=d74ba06aac5c41fb84b55297050305ad, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.649119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.652550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.655397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:04.671662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:04.672636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:04.673614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:04.679059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 299/603] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:04.679059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.720870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 305/604] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:04 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/d74ba06aac5c41fb84b55297050305ad/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:04.720870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:04.869957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119d1d7-7a31-484c-b4e6-d27a099e4a35 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.929284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21244-21ed-4a03-bfbc-3fadc998eb62 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:04.950789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:04.951760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:04.952048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:04.952329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c8839b9c0fca4cffb2bae93393cb7db7/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:04.972724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=c8839b9c0fca4cffb2bae93393cb7db7, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:04.974253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a6a7-fbc5-4fb6-852b-1bfbd7bb60ce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:05.001478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:05.002146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.002477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.002805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.003628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:05.003944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:05.005369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:05.019571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 306/605] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:05.025990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:05.043029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:05.072180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:05.078183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 300/606] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:04 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c8839b9c0fca4cffb2bae93393cb7db7/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:05.157924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5fa7-b44f-4e27-8100-9f41f152131b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:05.223120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:05.224061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.224348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.224625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/a9a0512f3f084ca791825b70b0d1c6b8/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.252598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=a9a0512f3f084ca791825b70b0d1c6b8, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:05.254101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:05.300274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c8bb-b447-471d-8a18-d10f9af8f7df None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.300592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c8bb-b447-471d-8a18-d10f9af8f7df None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.300844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c8bb-b447-471d-8a18-d10f9af8f7df None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.302605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 301/607] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:05.309896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.310184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.310463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.328110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 307/608] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:05 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/a9a0512f3f084ca791825b70b0d1c6b8/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:05.334438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:05.335691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:05.435772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 302/609] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:05.454273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:05.528980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:05.591506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae571ea-f732-4e1d-b25c-91f6d94786bd None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:05.634708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:05.636700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.637328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.637817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.649154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-b010b365-cf89-415c-8b8d-ceb19803b5ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:05.657677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:05.658648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:05.659513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:05.662431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 308/610] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:05.672725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:05.739073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb02-eb0a-4723-aa04-d1e633403f16 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.739397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb02-eb0a-4723-aa04-d1e633403f16 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.739606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb02-eb0a-4723-aa04-d1e633403f16 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.741098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 309/611] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:05.747118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.747414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.747735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.781607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba11de-b92d-49e2-a70f-8006f5c5d779 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:05.790097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:05.791694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:05.815976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:05.826366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:05.833853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:05.833853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:05.833853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:05.833853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:05.833853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:05.834349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:05.853322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 303/612] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:05.861063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:05.912712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 310/613] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:05.952625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.032395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.037666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f10479-9e2e-40fd-9069-87d629e1cfca None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.076726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2e70d-6e6c-46cd-b6ce-e57cb99825d0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.112177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.112823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.113255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.113627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.113747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.113911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.114172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.114288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.125987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:06.134013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:06.134995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:06.136045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 311/614] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:06.140330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.142142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.153120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:06.179778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:06.180801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:06.181809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:06.181809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:06.181809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:06.181809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:06.190322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 304/615] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:06.191255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.284387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958809-f892-49f6-acab-4fb54e6c6f1b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.319735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.320409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.320694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.320968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.321721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:06.322027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.323930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.332914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 312/616] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:06.333379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.335850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.338623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.450885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8f86-0fdb-486b-a664-bcf9fe9e7565 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.489352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.490486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.490995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.491451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.504465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.506184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.523395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce345-ebb0-4d82-a5b3-5421e07c7e0e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:06.525234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:06.526275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:06.527250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:06.527250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:06.527250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:06.527250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:06.529943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 313/617] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:06.536165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.587955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.608858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.610678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.610678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.610678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.610946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:06.611109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.612519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.634086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 305/618] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:06.640483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.686995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff587c-8487-4702-be35-373ab6254561 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.724033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.724805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.725095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.725374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.726101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:06.726465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.727907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.740278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 314/619] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:06.745896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.793896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc854-5af3-46e6-a928-1162a64433a4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:06.798777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.850543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:06.851372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:06.851687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:06.851967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:06.861494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:06.863202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:06.887929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:06.888959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:06.889939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:06.892453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 306/620] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:06.897305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:06.928699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:06.953723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f2da-6e40-4b8f-9a5d-31610ea24fb2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.023363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.024193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.024479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.024756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.041016 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.042536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:07.072792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:07.074334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:07.075400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:07.078814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 315/621] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:07.082582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.093621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49aaf0-6d87-435f-aca7-bfedae928071 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.133264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.133936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.134219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.134496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.135389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:07.135764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.137407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.158421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 307/622] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:07.164866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.213685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.282045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6361-46f1-465d-ae1a-3c24246a8671 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.349251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.350716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.351386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.353072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.354119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:07.355884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.357552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.375490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fe16a-b61c-4ea3-9365-1ee1751b39ba None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.393855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 316/623] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:07.401052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.407851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.449483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.450168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.450405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.450679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.537071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73428-e471-49d3-ad2e-3cdec23f5c41 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.573881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.574663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.574952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.575235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.586082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.587735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:07.606599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:07.607590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:07.608941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:07.608941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:07.608941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:07.608941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:07.608941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 317/624] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:07.613705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.633804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.635276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb913991-c604-4965-9a44-6d4e3b03438e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.675766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.677005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.718816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e6376-ca76-4b6a-a487-d06cd2b8efb6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.754288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.754952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.759786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.759786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.759786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:07.759786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.759786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215c61-2efb-4cd5-a40d-eb88cf341f14 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.760143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 308/625] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:07.760559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c39a-a98f-4b69-ab22-679935695db3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.760964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c39a-a98f-4b69-ab22-679935695db3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.761416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c39a-a98f-4b69-ab22-679935695db3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.767277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 309/626] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:07.768137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c39a-a98f-4b69-ab22-679935695db3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.770648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 318/627] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:07.776203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.777029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.777487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.795106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:07.796365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:07.875691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 319/628] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:07.876578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:07.897051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c39a-a98f-4b69-ab22-679935695db3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:07.923862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.935565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:07.936356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.936636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.936907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.945265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:07.946715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:07.948775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b00780e3-b3f5-407f-ba7b-a1e79978da0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:07.965852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:07.967074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:07.968257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:07.968257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:07.968257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:07.968257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:07.971672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 310/629] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:07.973928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091cd7-eb97-4a7d-af95-cc3245089556 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:07.974355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091cd7-eb97-4a7d-af95-cc3245089556 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:07.974958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091cd7-eb97-4a7d-af95-cc3245089556 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:07.976476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 311/630] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:07.977883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05091cd7-eb97-4a7d-af95-cc3245089556 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.008690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8983c5d-3d42-4af0-92fc-bfb4f5a515bf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.046719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.047801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.048090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.048589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.056077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.057544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:08.073909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.074886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 320/631] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:08.089908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.103893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05091cd7-eb97-4a7d-af95-cc3245089556 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.139398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.140151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.140438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.140723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.151264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a6193ffd-cc72-42e0-acde-541df3933571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:08.159723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.160755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:08.161621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 312/632] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:08.162358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.162358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.163117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.179451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:08.180658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:08.199769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671122f-5bf6-44f4-8929-936dd8c5040f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.207020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.207659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.234907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.235873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.236157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.236443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.237158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:08.237465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.238836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ac45-9db9-4c27-808b-4d625a32fdbf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.247415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 313/633] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:08.248492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 321/634] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ecd0-5b96-4e93-b599-85791f1c7bf3 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ecd0-5b96-4e93-b599-85791f1c7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ecd0-5b96-4e93-b599-85791f1c7bf3 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 322/635] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:08.264793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ecd0-5b96-4e93-b599-85791f1c7bf3 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.353142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4258525-a041-4757-abc1-764b4b0aa797 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.370910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ecd0-5b96-4e93-b599-85791f1c7bf3 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.387942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.388594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.388878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.389151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.389973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:08.390227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.391688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.403787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 314/636] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:08.404850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.409535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.410314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.410604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.410889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.411669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:08.411982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.413352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe9b92-8c05-478b-88c0-19aac4ce2bfd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.421721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 323/637] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:08.422939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.423247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.423513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.434692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.441448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:08.446726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:08.466369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.509357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 324/638] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:08.509528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b5e7b-615e-4d94-ab2b-ee8e0edb5ef1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.510174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.545429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.546221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.546510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.546788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.553426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.554902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:08.568901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.569938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:08.571020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 315/639] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:08.572140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.610133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074623-c978-458b-9144-42bf1fd7d3df None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.645137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.645884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.646172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.646449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.656806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:08.656952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:08.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.666436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:08.667892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 325/640] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:08.669955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.672977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944397a6-c457-4204-98b1-ea294c54e580 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.688712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.705911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.706790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.707073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.707351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/b2ec321b639b467595aa54be55e84956/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.722996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=b2ec321b639b467595aa54be55e84956, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.724465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.768590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147de31-f6fe-4677-83fa-948d8c7a876e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.803820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.804612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.804896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.805173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.805263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 316/641] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:08 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/b2ec321b639b467595aa54be55e84956/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:08.806053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.825945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:08.827630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:08.847518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.848611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.849544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:08.849544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:08.849544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:08.849544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:08.849544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 326/642] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:08.849864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:08.931445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.934290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96d359-38f6-40ea-8c3b-634649c23ddd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.966085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e492bd1-2ba9-4534-b40c-178d9b7df443 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:08.973852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:08.975165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:08.975454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:08.975767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:08.978748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:08.989249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:08.997738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:08.998708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:08.999671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 317/643] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:09.004564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.009512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.009512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.009512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.009512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.011960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.011960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.012865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.025654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 327/644] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.027307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.126276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e4d7-7714-4dbd-b3b1-561a8ce1feb6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.138203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2e03-ad59-45ab-a231-3df02db3f34a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.161918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.162509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.162792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.163069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.163834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.164141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.165493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.172130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.178645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 318/645] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.178645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.183751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.185508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.185508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.185508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.185884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.186200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.187584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.206995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 328/646] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.207895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.238367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.284090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abc441-c449-43f7-8cec-45b24e2fbfad None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.317820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd217c-f4cb-4961-a900-6f2aad969eaa None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.321730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.322401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.322691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.322971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.324124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.324447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.325950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.338475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 319/647] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.338475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.359396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.360089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.360379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.360657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.361484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.361797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.363216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.369653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 329/648] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.370565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.437287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.480188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0c295-3b36-4d94-960d-c4325e25df76 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.501204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.503426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25644b54-6223-4d39-8dfc-076da9b90da9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.521305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.522255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.522615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.523165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.536971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.539462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.552594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.553691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.554134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.554553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:09.560055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:09.561229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:09.562351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:09.562351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:09.562351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:09.562351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:09.566426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.568228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 320/649] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:09.568903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.569244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:09.586525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:09.587670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:09.588675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 330/650] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:09.589624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.708876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3934d3-9983-480a-a617-8a894ff82329 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.724321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148999-68d3-481c-a719-09fb8733044b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.740036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.755755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.756711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.757000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.757593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.762690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.765347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.765347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.765347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.765347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.765347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.766803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.770769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.772246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.782117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 331/651] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.783722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:09.800094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:09.801048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:09.801995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:09.801995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:09.801995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:09.801995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:09.801995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 321/652] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:09.802746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.828579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:09.895920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5913fb-fd8c-4a11-b814-524e7f54c07d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.908926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b518b4-c508-470f-9d8d-1a9ba707d82d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:09.936049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.936827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.937121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.937502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.938350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:09.938662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.940285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.949419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:09.950436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:09.951769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:09.952056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:09.961216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 332/653] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:09.961458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:09.962169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:09.962907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:09.991504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:09.993541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:09.994927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:10.003551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 322/654] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:10.003551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.006123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.080411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b781-88bf-4470-90ca-4fd6e7939401 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.094571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.115405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca184975-1aae-4f91-adc0-e2d6ac784560 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.117258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.118033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.118424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.118824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.119899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:10.120581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.136168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.136168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 333/655] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:10.136168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.155172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.155896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.156187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.156571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.237962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.239405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.242724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.255555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2095deb-0ea2-4749-9ec8-d811b6254340 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.291449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.292511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.293043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.293452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.294400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:10.294822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.296380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.314865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 334/656] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:10.315904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.336320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.361937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 323/657] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:10.362937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.425755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e4135-50d4-4463-90a8-cba21e82deed None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.463696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.465028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.465423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.465809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.473595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.473830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387ec38-75e6-46b2-bc82-499ea4bb8c53 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.475246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:10.490691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:10.492494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 335/658] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:10.494767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.507164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.513214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.514109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.514541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.514963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.570628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.592068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.593857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.600813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f957bfd-c29f-424e-8897-8ad65ddb8b25 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.639239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.640102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.640392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.640674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.652686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.654409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:10.673404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:10.674590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:10.675760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:10.675760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:10.675760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:10.675760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:10.680132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 336/659] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:10.680900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.720273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 324/660] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:10.721549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.747605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.788287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e5a3-944e-4d03-95c4-74a5e9a00ad3 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.814577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:10.827162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.827894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.828185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.828492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.829413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:10.829686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.831213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.840608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fadb27-c2aa-4d75-b134-5b36ab3b7f5e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.852764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 337/661] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:10.853479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.880313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:10.881220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:10.881732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:10.882257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:10.883115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:10.883602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:10.885385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:10.898294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 325/662] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:10.899349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:10.962943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b6ec-2c69-4677-b6be-90c2d890d288 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:10.984756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.002691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.002691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.002691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.002691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.011682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.013378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.013848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82955de-3f23-4c49-a16b-9a7d68140d05 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:11.032509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:11.033663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:11.034741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:11.034741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:11.034741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:11.034741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:11.038226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 338/663] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:11.039097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.054945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.055849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.056357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.056781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.070656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.134835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.137280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9e41e-4d8d-45dc-a16d-863c6071de1e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.148171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524acb-7e0d-4028-9203-e16a12c249a4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.185875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.186674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.186960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.187239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.194268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.195750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:11.211033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:11.212365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:11.215941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:11.219391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 339/664] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:11.220288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 326/665] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65489-7006-4423-a7c9-6092f793559f None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65489-7006-4423-a7c9-6092f793559f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65489-7006-4423-a7c9-6092f793559f None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 327/666] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:11.251605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65489-7006-4423-a7c9-6092f793559f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.254162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.302819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.334227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fea3-3f5e-4f24-b0ba-55cf24b51bf4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.367671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65489-7006-4423-a7c9-6092f793559f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.372359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.373035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.373324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.373603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.374323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:11.374634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.376047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.392194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 340/667] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:11.392194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.408569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.409261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.409522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.409781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.410563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:11.410925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.412349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff9316-118f-46c7-8375-449126b7234b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.424490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 328/668] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:11.425702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.425990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.426265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.445295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:11.446498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:11.501365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.511808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf6c0-3bdd-49da-bb26-b14f7c783276 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.525554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 329/669] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:11.525554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.552885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.553807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.554096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.554374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.564355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.567266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.568758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:11.586637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:11.587639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 341/670] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:11.588835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.642046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dba1e9-e900-46b0-a4b3-598bfd2c14a8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.681159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.681957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.682241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.683189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.690339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.691822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.698981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ac101-d42b-4ae0-9876-ce49f71d2a08 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:11.705602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:11.706701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:11.707683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 330/671] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:11.708210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.741865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.742766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.743233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.743730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.744651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=d74ba06aac5c41fb84b55297050305ad) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:11.745158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.746665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.752921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 342/672] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/role_assignments?user.id=d74ba06aac5c41fb84b55297050305ad&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:11.753710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.766894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.833665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:11.843413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e919-c962-4235-9ef3-7f8a9e0a3b17 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.874918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cff97-c15c-49c0-ae5c-4eb93cbcec66 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:11.885136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.886478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.887072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.887354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.900084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:11.908719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:11.909738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:11.910618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 331/673] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:11.911340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:11.920873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:11.921567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.921856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.922135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.922867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:11.923177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:11.924620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699743-c75b-4e21-b4e6-5b1d130f45b5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:11.938382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 343/674] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:11.944091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168475-7d38-44e7-9110-9361f11bbf00 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:11.944392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168475-7d38-44e7-9110-9361f11bbf00 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:11.944659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168475-7d38-44e7-9110-9361f11bbf00 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:11.946012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 344/675] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:11.950859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168475-7d38-44e7-9110-9361f11bbf00 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.021682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.040475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad87f-2d15-414d-916c-1d50fe5ca2af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.060510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168475-7d38-44e7-9110-9361f11bbf00 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.079268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.079970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.080258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.080538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.081323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.084350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.084350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.096600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 332/676] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.097452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.098127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.098414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.098692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.099435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.099788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.101189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b065-eb76-4f2b-b793-900061d1d99b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.101944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.110575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 345/677] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.113038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.113038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.113038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.123840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.130339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:12.131553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:12.206690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 346/678] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:12.207793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.228962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175186c9-4d54-4474-97c3-7cd4a8c8f9e4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.265830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.266631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.266920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.267208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.274390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.275808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.277631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:12.290773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:12.292074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:12.293185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:12.295678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 333/679] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:12.296657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.327511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ec82-8e06-4b03-a72c-d6682526c57e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.363203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.363911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.364207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.364485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.365323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c8839b9c0fca4cffb2bae93393cb7db7) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.365641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.367071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.373456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 347/680] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/role_assignments?user.id=c8839b9c0fca4cffb2bae93393cb7db7&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.374281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.384667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.423437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abc041-4a69-4c86-b986-ca80007cb511 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.463186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.464953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.465413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.465857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.478136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.480190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.490635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e003-2de5-451f-a275-e4c63e75a3ad None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:12.499723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:12.500727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:12.501649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:12.501649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:12.501649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:12.501649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:12.503672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 334/681] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:12.504856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.523915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.536446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.536446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.536865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.537058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.555428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:12.567198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:12.568439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:12.569321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:12.575486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 348/682] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:12.576485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.628327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553158ce-752f-4851-8dfb-858f7b5e7448 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.658281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.670946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.672390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.672390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.672390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.673154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.673476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.675314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.688324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 335/683] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.689053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.704235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000eb8e-8859-43d1-9859-254da91a49f8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.750195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.751274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.751627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.752136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.752871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.753432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.755516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.771906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 349/684] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.776860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.804016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7b12d-a352-4e52-823c-df061bf6d489 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.825224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.842522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.843197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.843519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.843830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.844618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.844935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.846413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.857219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 336/685] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.858149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:12.886435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc4e05-6ffd-48af-a6e1-6a301371c9d5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:12.913417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:12.924912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=a9a0512f3f084ca791825b70b0d1c6b8) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:12.930856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:12.936815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 350/686] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/role_assignments?user.id=a9a0512f3f084ca791825b70b0d1c6b8&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:12.937842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.017901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed6b-5fb3-44b6-bf5f-070115fbdbea None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.077121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.077871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.078156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.078432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.091958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89599a-0480-43d7-9876-4280f7036197 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.096647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.098165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.112114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:13.126669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:13.127766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:13.128726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:13.137929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 337/687] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:13.143787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.167898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.168927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.169217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.169497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.188687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.190234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:13.213069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:13.215195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:13.217376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:13.217376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:13.217376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:13.217376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:13.217376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 351/688] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:13.220484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.285748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18082aa-649c-44d1-8603-dd1d96efdbae None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.293735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.324813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.325593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.325880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.326439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.327392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:13.327848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.329626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.351641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 338/689] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:13.357539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fca82-172e-4f8f-9088-dddc47580408 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.363585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.407358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.408826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.408826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.408826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.409524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:13.409916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.411288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.426261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 352/690] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:13.431394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.455630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.485144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd30c9-e25b-46d7-859b-48199c9dfe3f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.522277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.523200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.523659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.524074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.560943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.591344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821192b3-9dcc-4c4f-969e-5931b2aedc74 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.598028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.599734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.672501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.673663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.673663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.673943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.692685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.694154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.706354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 339/691] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:13.716561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:13.717447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:13.718475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:13.719798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 353/692] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:13.724879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:13.843986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.879929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:13.900857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ed3b-a889-430e-a3fa-65689d113828 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.919309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb390c2-0229-458e-9597-c6b9f23e28a8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:13.941529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:13.942348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:13.942632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:13.942999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:13.955565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:13.957220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:13.974840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:13.975845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:13.977128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:13.977128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:13.977128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:13.977128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:13.977128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 340/693] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:13.982142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.004024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.004699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.004981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.005254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.006093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:14.006401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.007855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.039284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 354/694] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:14.045986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.147657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5f2c1-c45a-4b00-8845-650cdeffbf3b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.168936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.190571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.191236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.192083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.192386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.193117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:14.193424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.194859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.208630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 341/695] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:14.215247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.251054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca971c13-a111-4f11-9744-6d51378375df None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.314905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.315650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.315944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.316221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.332472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.365492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9e17e-6e50-44d4-bae2-6f9826ac7f88 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.394056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.396169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df319744-40cf-4de9-9fe7-a0705fe8b904 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.410475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.411498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.411809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.412132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.424140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.425582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-171703c9-ab7b-4988-87d1-9cae091c6c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:14.440385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:14.441336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:14.442246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 342/696] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:14.443189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa493-9585-4c37-8c13-3f4a4d7962ad None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.443468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa493-9585-4c37-8c13-3f4a4d7962ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.443766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa493-9585-4c37-8c13-3f4a4d7962ad None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.449437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 343/697] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:14.450234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aa493-9585-4c37-8c13-3f4a4d7962ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.491620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.521314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 355/698] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:14.523022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.523555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.524168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.542730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:14.544332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:14.562245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aa493-9585-4c37-8c13-3f4a4d7962ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.579882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.598702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.599369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.599728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.600019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.600803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:14.601118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.602609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.620878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 344/699] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:14.620878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.640700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 356/700] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:14.642558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.736105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.742206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ba36-bb14-416f-b8f0-d4e4132324ad None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.759165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de43347-e31c-49b8-a833-ee3ed82d397b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.780548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.781300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.781661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.782012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.793449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.795190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.801138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.802082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.802608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.803088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.804152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=b2ec321b639b467595aa54be55e84956) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:14.804746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.806466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:14.819749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:14.820746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 345/702] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:14.821763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.822644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 357/702] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/role_assignments?user.id=b2ec321b639b467595aa54be55e84956&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:14.824532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:14.880227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:14.931584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604288-1a2b-41c5-9502-21ba36491d3e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:14.967445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:14.968403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:14.968853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:14.969229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:14.980418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:14.982052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:14.991867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c75b840a-c88d-4f20-aa04-993a4443ebdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:15.002344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:15.012854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 346/703] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf706-23b9-4f0a-8a01-68dfef98b8c2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf706-23b9-4f0a-8a01-68dfef98b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf706-23b9-4f0a-8a01-68dfef98b8c2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.013802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 347/704] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:15.014331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf706-23b9-4f0a-8a01-68dfef98b8c2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.014401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affc48c-db33-45e6-8fa7-ec5cc7af196e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.062154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.063316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.063928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.064416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.065381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:15.065918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.067778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101c20-fa8b-4b68-a285-32635d3ea7ff None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.082826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 358/705] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:15.084654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.085247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.086905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.106376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:15.108116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:15.132908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbf706-23b9-4f0a-8a01-68dfef98b8c2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.177593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.178327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.178620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.179005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.180148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:15.180461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.184058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.202407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 348/706] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:15.203251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.207560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 359/707] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:15.208303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.234889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.278660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.331400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22bf1-4821-423d-8a1b-762d7157ca79 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.347719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da645c-8645-4107-970b-1af9ea2062f9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.379351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.380258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.380545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.380826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.387995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.388948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.389462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.389886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.390161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.391065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.391349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.392936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:15.408558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:15.409536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:15.410559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 349/708] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:15.411064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.472234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 360/709] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:50:15 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:15.473875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.572259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7516a3-b80c-4cef-8c82-e92392448a28 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.586452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.618757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9937-e689-467d-98c0-f5b46044f6bf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.631428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.662266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.663084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.663392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.663715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.664913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:15.665237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.667556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.683597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 361/710] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:15.689109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.695373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.696224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.696508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.696782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.697437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.699609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:15.715752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:15.717050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:15.717919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 350/711] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:15.722897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.831987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6302c-12fc-4018-a1da-15efc60e0d91 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.868626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98b96-11bc-4b68-8f03-3890e209025b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:15.886565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.887236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.887556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.887875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.888713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:15.889026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.890452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cae89-e8f3-4a07-a1ee-b13d6bcfde2c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.897500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 362/712] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:15.936766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:15.937457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.937743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.938023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.938745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:15.939055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:15.940476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:15.945963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 351/713] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:15.951094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbbc9-9e2f-4899-909a-2b4ff3962a3f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.951394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbbc9-9e2f-4899-909a-2b4ff3962a3f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.951700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbbc9-9e2f-4899-909a-2b4ff3962a3f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.953159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 363/714] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:15.954155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:15.958809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:15.959103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:15.959377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:15.964686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:15.977242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:15.978556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:16.025314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:16.085470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f17ed-d652-4342-836f-b7e6e4f7e029 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:16.125014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:16.125693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:16.125972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:16.126243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:16.126952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:16.127253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:16.128724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:16.136348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 352/715] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:16.157888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 364/716] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 12:50:16.190162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:16.328882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075da4-34a7-4383-b606-8ecb0e53a022 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:16.348427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:16.372711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:16.373527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:16.373855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:16.374132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] PATH_INFO: `/v3/services/network` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:16.374788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:16.376205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:16.389367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:16.391058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:16.392095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:16.395005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 353/717] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:16 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:16.401430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:16.509628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463a0fa-4538-41fd-86c2-7054107a0ac0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:16.540933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:16.551014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] RBAC: Adding query filter params (name=network) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:16.555742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148dfd2-8e93-49bb-ad16-dfa002a204bd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:16.560794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 365/718] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:16.566277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:16.699416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2736-f3e4-43f4-b0d4-b64181c97097 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:16.744970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:16.745638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:16.745913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:16.746189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:16.746884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] RBAC: Adding query filter params (type=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:16.747189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:16.748578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc028-194f-4d93-8312-1d89b920721a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:16.759423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 354/719] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:17.624989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e99c-4a8b-47f7-9c2a-4a2f87c12fb2 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:17.625970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e99c-4a8b-47f7-9c2a-4a2f87c12fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:17.626473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56e99c-4a8b-47f7-9c2a-4a2f87c12fb2 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:17.628346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 366/720] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:17.634278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:17.634728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:17.634817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:17.655173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:17.656407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:17.707050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:17.752271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 355/721] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:17.801045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56e99c-4a8b-47f7-9c2a-4a2f87c12fb2 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:17.956577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56e99c-4a8b-47f7-9c2a-4a2f87c12fb2 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:17.999311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.000147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.000434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.000709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.020299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:18.029560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:18.030586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:18.031451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:18.035771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 367/722] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:18.037276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:18.222737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2cc5c-92e5-4ac9-83b7-7bc22441947c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:18.257668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.258321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.258611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.258894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.259667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:18.260045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:18.261544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f9e47-c5f7-4410-9156-d0b6d2c99661 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:18.270282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 356/723] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:18.276105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:18.375887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:18.434315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a0c49-7c15-4be2-9f94-6b312afa4d05 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:18.475092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.475844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.476133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.476415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.489157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:18.490627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:18.492697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576981-7a28-4fe8-aabe-84ae0d70d027 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.492986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576981-7a28-4fe8-aabe-84ae0d70d027 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.493262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576981-7a28-4fe8-aabe-84ae0d70d027 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.495011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 357/724] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:18.500443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.500732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.501012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:18.513582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:18.514583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:18.515537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:18.515537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:18.515537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:18.515537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:18.515537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 368/725] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:18.520510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:18.525554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:18.527092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:18.586075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:18.658849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 358/726] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:18.696659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac28-20d7-42fc-9708-e1b625a91ea5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:18.701946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:18.707333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:18.735231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.736004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.736303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.736695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.737438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:18.737756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:18.739164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:18.756824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 369/727] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:18.757825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:18.897330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df2a6-05c0-44de-b542-6bf8dda36005 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:18.939564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed2831-5ca0-4c37-a329-439f7df6e2a1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:18.988375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.989102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.989391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.989678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:18.991828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:18.992625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:18.992905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:18.993177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.008254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.009723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.015993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c02c217d-214e-4c30-af52-88b462a1135b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:19.037175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:19.038245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:19.039200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:19.039793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:19.040663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:19.041604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:19.042246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 370/728] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:19.042323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 359/729] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:19.042393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed866f2-65fe-49b5-beda-ce0501aaf93a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.042393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed866f2-65fe-49b5-beda-ce0501aaf93a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.042533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed866f2-65fe-49b5-beda-ce0501aaf93a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.047143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.048186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 371/730] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:19.049481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed866f2-65fe-49b5-beda-ce0501aaf93a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.081703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.088426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.184894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bb57-e9e4-40d8-9e7b-13f48fb2f3e0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.185223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed866f2-65fe-49b5-beda-ce0501aaf93a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.230875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.231563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.231856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.232131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.232874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:19.233105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.233291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.233786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.234074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.234351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.234514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275a455-f24a-4369-8010-cd4fb02f14a7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.235190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:19.235497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.237729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.244132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 360/731] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:19.245750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.246048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.246330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.259657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 372/732] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:19.261304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.269620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:19.270882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:19.342268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 361/733] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:19.343160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.368810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.370544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.386492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207aa5-6851-4c99-b507-f535e012d09a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.422145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.422936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.423222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.423499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.434014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.435455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-7c5781df-a8a9-4063-8db0-561dc206171e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:19.453142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:19.454222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:19.455157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:19.455157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:19.455157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:19.455157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:19.455157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 373/734] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:19.455449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed0c0-5cc7-4f54-9811-351b2081cdda None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.455905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccce2a-c427-4960-b590-4514db717394 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.456196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccce2a-c427-4960-b590-4514db717394 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.456479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccce2a-c427-4960-b590-4514db717394 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.457737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 374/735] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:19.458424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccce2a-c427-4960-b590-4514db717394 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.493745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.495154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.495574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.495864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.559284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccce2a-c427-4960-b590-4514db717394 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.566015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.567467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358cc8-0b94-4b9f-a3ef-b260855849e1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.581918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.594314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.595100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.595393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.601658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.602623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.606830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-85fe5552-94e6-4211-9db7-6d70d272524c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:19.614430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:19.615587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:19.616569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 375/736] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:19.617293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812179a-63c9-49a5-9e67-2120f48b1998 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.617293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812179a-63c9-49a5-9e67-2120f48b1998 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.617539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812179a-63c9-49a5-9e67-2120f48b1998 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.618766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 376/737] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:19.620324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812179a-63c9-49a5-9e67-2120f48b1998 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.671773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 362/738] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 12:50:19.673166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.673459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.673744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.689760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:19.690969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:19.724914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812179a-63c9-49a5-9e67-2120f48b1998 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.757797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 363/739] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:19.758559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.773215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.773887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.774218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.774570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.775231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:19.775590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.777063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9629b-6eee-45e7-a4d6-77c39ce1e8e1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.789125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 377/740] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:19.790439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.790805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.791301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.804771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.807761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:19.808963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:19.857739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25711af4-6a7c-495e-9e2d-21b2a043edf2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:19.861684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:19.875466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 378/741] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 12:50:19.876302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.898402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:19.899162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:19.899451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:19.899776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:19.900636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:19.900932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:19.902325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:19.912678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 364/742] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:19.913458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:19.981656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cb743-3cee-490a-8691-caf7fb32c36e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.013728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cbd9f-3c82-46f3-897b-275fe17c6104 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.015665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.017197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.017489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.017772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.020472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.028375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.030113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.046823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.047475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.047787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:20.047880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:20.048896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:20.049826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:20.049826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:20.049826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:20.049826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:20.050067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.050067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.050204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 379/743] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:20.050204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.050329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.092136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.142783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 365/744] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:19 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:20.143486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.157102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0f3d7-cbe9-4f4d-b49c-af23c24d1b4c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.235153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.236089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.236784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.237195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.245828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.247335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:20.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:20.266536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 380/745] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:20.272771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.321876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1245dde-1f27-4154-9bf2-d10a4b1fa041 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.364675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.365339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.365618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.365890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.366605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.368046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.384839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.392241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bc015-a17b-4a6e-bfb1-ab25d5553c5c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.426487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.427286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.427637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.427934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.435123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 366/746] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:20 2022] POST /identity/v3/services => generated 240 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:20.435981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.438783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.440509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:20.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:20.466079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:20.466990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:20.466990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:20.466990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:20.466990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:20.473889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 381/747] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:20.475385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.482592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.577607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df44bf-a3a0-46a2-9188-a208db49fa2a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.616931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.617930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.618393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.618876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.621020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:20.621766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.623430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.625053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634c6a-dc1e-4ddb-8750-94a890b0217b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.637611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 367/748] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:20.638955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.671763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.672446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.672735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.673019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.673865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:20.674175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.675641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.698585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 382/749] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:20.701495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.711874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.747453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:20.767744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951b6e-0b52-45f2-bb91-25a7ef2e294f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.809717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.810788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.811077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.811352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.812460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:20.812772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.814329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.830676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 368/750] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:20.830857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da295e5-265d-470e-b613-4f9003f28bbf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:20.831429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.867676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:20.868845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:20.869400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:20.869884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:20.877630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:20.879386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:20.895832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:20.896811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:20.897757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:20.908518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 383/751] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:20.909382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:20.957780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1c3b-a51f-4cd5-9288-4bf779e58fd5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.003849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.010082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.010745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.011028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.011304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.025835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.058105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec611f-14ec-40a4-b000-11b3574c005b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.099182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.100957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.101538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.102013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.102127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.103686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.112776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.114325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:21.129422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:21.130398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:21.131356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 384/752] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:21.132006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.250453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 369/753] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:50:21.250453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.269426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44a47b-a2c6-4705-9d3e-9140e73fcf24 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.295172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.299518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.311380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.312556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.313355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.313845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.315032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:21.315695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.317919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.333432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 385/754] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:21.334544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.363647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f499a4-c23a-4283-8ff4-7189520b239e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.402913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.404114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.404542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.404982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.405961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:21.406437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.408050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.427182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 370/755] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:21.428243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.455642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60017f-e08e-48c3-a797-05023fb13a47 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.492356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.493303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.493694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.494144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.504956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.506542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:21.525612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:21.526624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:21.527655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:21.527655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:21.527655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:21.527655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:21.531992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 386/756] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:21.532858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.536914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.540309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f267-fe65-4a50-8a54-f37556f1d690 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.577086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.577628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.578410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.578901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.579383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.580437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=b2ec321b639b467595aa54be55e84956) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:21.580971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.583467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.589671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 371/757] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/role_assignments?user.id=b2ec321b639b467595aa54be55e84956&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:21.590715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.686917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8849c-309f-4229-b091-e9c51db64541 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.708337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54e201-362f-4940-8f73-c6cd3b5748d0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.746255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.747405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.748103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.749053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.750020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:21.750571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.751676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.752493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.752781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.752887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.753078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.767485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 372/758] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:21.776906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.777124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.778640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:21.798663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:21.799671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:21.800645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:21.800645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:21.800645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:21.800645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:21.800645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 387/759] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:21.813104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:21.819803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.928176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:21.943892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42b263-fe72-45e7-9034-ecd6694b36a1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.986940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:21.987732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:21.988021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:21.988348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:21.989076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:21.989387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:21.989607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dabfc-2d51-4987-a0ab-369aaf3675e5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:21.990765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.004335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 388/760] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:22.009844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.032569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.033368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.033652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.034365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.042203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.043683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:22.059677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:22.060659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:22.062259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 373/761] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:22.068483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.196656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1635-0a74-48aa-ba4a-32129ede84bc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:22.218925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:22.237939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.238762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.239050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.239333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.257017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743024c-4c84-414c-bee3-d17f0557b89b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:22.259735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.261412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:22.293786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:22.294771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:22.295734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:22.298252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 389/762] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:22.303698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.314697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.315378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.319579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.319579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.319579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:22.319579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.319579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.329214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:22.331864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 374/763] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:22.337624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.443026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44dfb-5605-45de-a475-b58d058c7ca7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:22.479847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.480431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.480722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.481003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.481836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c94073eaf78b44c0b50eb85460904ffd) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:22.482153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.485914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.494779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 375/764] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:22 2022] GET /identity/v3/role_assignments?user.id=c94073eaf78b44c0b50eb85460904ffd&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:22.505634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3e33-d2a5-4509-b635-ec45eb5bd43e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:22.544085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.544779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.545067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.545350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.546159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:22.546472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.548071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8b6de-2efc-4959-a79b-77ed3c272de8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.568485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.568940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 390/765] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:22.581894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:22.649142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fa66-27a7-4c43-bfec-336f4829b4c5 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.649458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fa66-27a7-4c43-bfec-336f4829b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.649716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fa66-27a7-4c43-bfec-336f4829b4c5 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.652009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 391/766] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:22.665432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.665747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.666028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.696663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:22.698647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:22.721211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd0aa1-1e76-4410-9cf0-ebebfdfe10ab None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:22.802955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:22.803808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.804091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.804363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.808227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=966c3cbce1b443fd9aae9c03cbe6a406, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:22.809681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff227e-3de8-4226-ae95-6a7ef7b65f7c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:22.824647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:22.831610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 392/767] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:22.849683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:22.908163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 376/768] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:22 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:22.946055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0fc9-8f24-4b63-b199-8efe7d08ba7d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.946380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0fc9-8f24-4b63-b199-8efe7d08ba7d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.946639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0fc9-8f24-4b63-b199-8efe7d08ba7d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.951599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 377/769] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:22.961080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:22.961421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:22.961638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:22.971193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ec141-4c19-4786-ac96-75ea88979dd9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.001602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:23.004281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:23.023091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.024533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.027015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.027630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.028803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.030839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:23.057811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:23.058811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:23.059696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:23.062857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 393/770] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 6 12:50:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:23.073815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.142624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:23.155704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 378/771] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:23.163945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:23.179887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.213921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a731-d841-402d-9c63-526dbe6bb243 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.262777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.264795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.265107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.265395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.267114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.267449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.268893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.275802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 394/772] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:23.281250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.304030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fb0ac-bd41-4b0c-9a32-3b11dfce0d7e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.342176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.343324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.343832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.344334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.345188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.346758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:23.359936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:23.361022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:23.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:23.364897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 379/773] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:23.371183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.452530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:23.490370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d75a-83fc-402f-84b0-555eda5eb7a4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.495396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed094-daf7-4518-b399-ef2bfe1885a4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.533136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.534195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.534695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.535190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.535924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:23.536165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.536477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.537847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.546761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.547971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.547971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.547971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.548810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.549237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.550621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.553903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 380/774] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:23.560376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.561203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 395/775] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:23.570601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.713987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993dc6-4602-439c-8f95-9cb57ba7ace5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.741075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:23.750691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.751395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.751680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.751956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.754164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] RBAC: Adding query filter params (type=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.754164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.754405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.760528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 381/776] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:23.771484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.814126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1128e-6344-47bb-b788-32a20cd8b837 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.887119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2aeff-5261-42a2-8496-ca12d08ad5fc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:23.919652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.920866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.927569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.927569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.927569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] RBAC: Adding query filter params (interface=public, service_id=ea59264710a84ecf813d225f104fcd39, region_id=RegionOne) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.927569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.927569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.929725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:23.930414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:23.930701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:23.930977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:23.936181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] RBAC: Adding query filter params (interface=public, service_id=41675eece70a4a0a9349c199fbf12649, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:23.936508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:23.937931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:23.942755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 396/777] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/endpoints?service_id=ea59264710a84ecf813d225f104fcd39&interface=public®ion_id=RegionOne => generated 194 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:23.944075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:23.954027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 382/778] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/endpoints?service_id=41675eece70a4a0a9349c199fbf12649&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:23.959382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:24.025359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:24.124616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:24.133816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b51e24-b96a-4939-9b68-1493a78a7622 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:24.229425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:24.230571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:24.232364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:24.233577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:24.235046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:24.237946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5350a-eda4-4493-be1f-8c79f14fc5b1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:24.257743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 383/779] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services => generated 772 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:24.268064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d817e4-b58c-4603-9427-1afb3aabb55b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:24.331376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:24.332347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:24.336049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:24.336555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:24.337520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:24.339104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb7b4f-af5d-4d28-8789-b0d9bf88d827 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:24.349462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 397/780] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:23 2022] GET /identity/v3/services => generated 772 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:24.895554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e997-8058-4500-b599-4cdae559226e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:24.895554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e997-8058-4500-b599-4cdae559226e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:24.895554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e997-8058-4500-b599-4cdae559226e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:24.896406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 384/781] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:24.902792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81402f-c8ab-4001-8af5-f1d43dc2456b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:24.903640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81402f-c8ab-4001-8af5-f1d43dc2456b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:24.904130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81402f-c8ab-4001-8af5-f1d43dc2456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:24.925551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0c81402f-c8ab-4001-8af5-f1d43dc2456b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:24.928144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0c81402f-c8ab-4001-8af5-f1d43dc2456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:25.008231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 398/782] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:25.054565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8e997-8058-4500-b599-4cdae559226e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.205328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8e997-8058-4500-b599-4cdae559226e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:25.230802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:25.252499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:25.253299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.253584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.253863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.275061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:25.283456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:25.284441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:25.285304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:25.287413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 385/783] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:25.292754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.293187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5951d-c179-4299-a35d-51b6b421d48f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.293709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5951d-c179-4299-a35d-51b6b421d48f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.293709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5951d-c179-4299-a35d-51b6b421d48f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.295216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 399/784] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:25.301854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.302437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.302916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.336598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:25.338086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:25.409126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27645600-31e2-4f96-96fa-120cc0e76502 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:25.445244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971244-1436-41d9-b99e-566e72958615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:25.446283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971244-1436-41d9-b99e-566e72958615 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.447400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971244-1436-41d9-b99e-566e72958615 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.447935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89971244-1436-41d9-b99e-566e72958615 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.448881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971244-1436-41d9-b99e-566e72958615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:25.449534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971244-1436-41d9-b99e-566e72958615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:25.451196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89971244-1436-41d9-b99e-566e72958615 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:25.458416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:25.461608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 386/785] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:25.467434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971244-1436-41d9-b99e-566e72958615 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.490899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 400/786] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:25.519996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.573987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:25.641520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddb3e-69b5-4597-abd6-d602a4c1eaef None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:25.681643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:25.682798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.683311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.683971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.696236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:25.706939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:25.707988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:25.708925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:25.709610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 401/787] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:25.716501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.753454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89971244-1436-41d9-b99e-566e72958615 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:25.768241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:25.803932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:25.807710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.807710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.807710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.828823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:25.830513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-21efcbc1-30d0-461a-a30b-1a23d643127c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:25.858284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:25.859448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:25.860661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:25.860661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:25.860661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:25.860661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:25.860661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 387/788] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:25.861059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd971d6d-4f58-4398-aab0-0f105c6fbc87 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.861352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd971d6d-4f58-4398-aab0-0f105c6fbc87 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.861655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd971d6d-4f58-4398-aab0-0f105c6fbc87 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.866126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 388/789] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:25.867172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd971d6d-4f58-4398-aab0-0f105c6fbc87 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:25.869461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801498-edf9-4131-ac3b-66290ea5e9e4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:25.924682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:25.925694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.926515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.926986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.928278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:25.929057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:25.930821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bc11-4365-44fb-8616-9b7cf72e354a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:25.941210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 402/790] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:25.942564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:25.942942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:25.943403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:25.961018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:25.962595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:25.998217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.000035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd971d6d-4f58-4398-aab0-0f105c6fbc87 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.039583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 403/791] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:26.039583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.054116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.054990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.055429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.056288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.058624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:26.059368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.062608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.077731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 389/792] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:26.078961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.097101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.182937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f714c-15cc-401b-bfc2-b70f787ad8b6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.203306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5183-fd34-4382-99ef-3add44c905f4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.220610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.221744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.222259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.222750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.234199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.236095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.240490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.241291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.241576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.241853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.253706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:26.257355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:26.258259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:26.259896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:26.259896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:26.259896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:26.259896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:26.262190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:26.263135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:26.264340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 390/793] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:26.265077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.265641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 404/794] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:26.267498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.282253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.357846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.376509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392277-7d1b-4caf-b87a-b2e594cd9f23 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.377314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a938-4bd4-4090-bad5-43b1ab66f442 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.414410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.415564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.415964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.416501 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.416848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.417100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.417205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.417646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.418726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:26.419221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.420846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.425285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.426854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.434903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 405/795] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:26.436018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:26.443255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:26.444482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:26.445464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 391/796] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:26.446097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.523160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.548795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb0a-78f0-4523-9871-f14b4c98714b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.558453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ead0-dfeb-462f-8912-76940d5c0f4a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.585158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.586025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.586383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.586737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.588474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:26.588914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.590570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.598961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.600060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.600280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 406/797] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:26.600778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.601191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.601470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.610513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.611857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.613190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:26.628646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:26.629678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:26.630659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:26.633591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 392/798] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:26.635312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.720027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c988f-e610-410e-b5d5-1016b9c68e39 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.748348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdd2f-f0b4-4237-a5b3-5e158bc56b4c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.757314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.758326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.758440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.758822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.760991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:26.761206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.762732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.781531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.783938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 407/799] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:26.784970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.788076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.789422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.789897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.791029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.807726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.809857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:26.829584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:26.830559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:26.831495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:26.831495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:26.831495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:26.831495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:26.833828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 393/800] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:26.834960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.862780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:26.911465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247f5-f7ab-4e10-abb9-e58513108bca None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.950169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f417-7b1e-400a-bd41-ddacd0ec2ba1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:26.957716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.958414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.958704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.958988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:26.960130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:26.960449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:26.961939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:26.982612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 408/801] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:26.983559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:26.990813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:26.991892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:26.992452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:26.992876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.005889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.008281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:27.026877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.027918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 394/802] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.029148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.066621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.110342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a940c5-ace9-4de0-b94d-793be8a2b4d8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.135497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.137835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f842c4-a644-457a-8724-2b2798ded665 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.148339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.149440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.150404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.151001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.151693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:27.152009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.153684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61aebe-c3cf-457e-8980-c0285b202bba None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.165172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 409/803] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:27.166698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6be1-d38c-4eab-a533-b6ef93fb39c6 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.166991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6be1-d38c-4eab-a533-b6ef93fb39c6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.167271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe6be1-d38c-4eab-a533-b6ef93fb39c6 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.171841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 410/804] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:27.171841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe6be1-d38c-4eab-a533-b6ef93fb39c6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.181379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.182185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.182469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.182750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.193707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.195167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:27.214320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.215274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.216246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:27.216246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:27.216246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:27.216246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:27.216246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 395/805] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.216552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.294931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe6be1-d38c-4eab-a533-b6ef93fb39c6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.311483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.326727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2827ff-de43-4a66-b5ee-e93440d2b856 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.329969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.330634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.330917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.331196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.331949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:27.332261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.333640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295db8c1-1910-4174-9d7b-749f23d05d3c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.345486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 411/806] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:27.346689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec600-f51f-4874-af12-93301a214b21 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.346978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec600-f51f-4874-af12-93301a214b21 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.347258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec600-f51f-4874-af12-93301a214b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.359359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.360199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.360484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.360762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.363398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b6fec600-f51f-4874-af12-93301a214b21 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:27.364586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b6fec600-f51f-4874-af12-93301a214b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:27.368174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.369693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:27.383613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 396/807] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.386656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.402609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.435776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 412/808] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:27.437228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cee90-2d7e-4153-9d04-ba1149f0b295 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.437527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cee90-2d7e-4153-9d04-ba1149f0b295 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.437810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cee90-2d7e-4153-9d04-ba1149f0b295 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.439063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 413/809] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:27.439773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cee90-2d7e-4153-9d04-ba1149f0b295 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.501868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ef8d8-bb55-4f3d-b34b-48dda3af3b40 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.536215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.536962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.537247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.537521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.538229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:27.538528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.538769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cee90-2d7e-4153-9d04-ba1149f0b295 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.539944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.551912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 397/810] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:27.552715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.564969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.578181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.578502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.578786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.579059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.585680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.587779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-26ce631a-fc3d-45a1-87ab-6674eb2bc681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:27.601235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.602172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:27.603231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 414/811] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.604011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.604276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.604399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.620417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:27.621604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:27.646883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.658011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a159-10d9-4605-adcb-ffc2ca3c3074 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.687096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 415/812] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:27.691636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.692299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.692418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.692581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.692852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.693663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:27.693969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.695386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.713854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 398/813] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:27.714676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.779005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.791959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100cdee-8658-4ac2-b189-675885177f7b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.813072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d717-649c-4360-aa3d-32ea0458fa8f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.824838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.825621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.825902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.826173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] PATH_INFO: `/v3/services/network` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.826810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.828244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.840289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.841292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:27.842150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 416/814] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.842971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.851804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.852600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.852961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.853240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.860022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.861477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.875361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:27.876285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:27.877355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 399/815] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:27.878424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:27.951594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115dec7-0aeb-4681-bddb-fbd84bf55eaa None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.980893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78a10b-3dd2-4018-b18f-b95cc6d41d60 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:27.984122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:27.984782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:27.985062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:27.985336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:27.986111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:27.986423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:27.987870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:27.999704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 417/816] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.000486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.007351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.016664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.018013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.018013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.018187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.018717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.020125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:28.032488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:28.033502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:28.034890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 400/817] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:28.036163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.086896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.102310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758c8f-2167-4aca-ad0b-aa800b37abbf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.134730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b651fd-2340-4661-9f80-953618c97972 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.137046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.137697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.137986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.138321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.168486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.169137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.169420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.169697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.170390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:28.170697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.172089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.176434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 401/818] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.177187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.207106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.208745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.230972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.275986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca94f5-96a4-4b44-a94a-d99c3f9913f4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.291649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.307156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 418/819] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:50:28.307962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.313814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.314481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.314768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.315048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.315981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:28.316294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.317747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.330705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 402/820] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.331504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.405321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc45b-f34a-4df8-b98d-00b40261a748 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.429701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e2fa-0089-4cd3-bd03-26ceadb73a4e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.437935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.438809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.439084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.439351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/b2ec321b639b467595aa54be55e84956/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.441297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=b2ec321b639b467595aa54be55e84956, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.442706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.443252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.463789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.464449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.464732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.465011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.465702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:28.466010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.467355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.472243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 403/821] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.473005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.497336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 419/822] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:28 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/b2ec321b639b467595aa54be55e84956/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:28.498138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.553979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.597101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f053031-9c9c-4c35-9d35-d54c10a20b95 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.618992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb752d18-2c15-40a2-b9a1-cd02137ddba2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.637416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.638473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.638473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.638689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.639335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:28.639675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.641098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.651743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 404/823] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.652582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.662152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.662889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.663178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.663460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.675721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.677226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:28.697602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:28.698670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:28.699625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:28.699625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:28.699625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:28.699625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:28.699625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 420/824] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:28.699922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.706694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.769263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c72f4-f373-43d7-a92c-dddbc20653c3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.802004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:28.806617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea46c-cc61-4184-8e15-4fa502073847 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:28.808109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.809006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.809294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.809572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c94073eaf78b44c0b50eb85460904ffd/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.825401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=c94073eaf78b44c0b50eb85460904ffd, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.826853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.842890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:28.843642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:28.843933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:28.844208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:28.844993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:28.845300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:28.846660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:28.851702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 421/825] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:28.853299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.928165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 405/826] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:28 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c94073eaf78b44c0b50eb85460904ffd/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:28.929543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:28.982515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cac43-d8f6-4ad3-bfca-8923f4363656 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.032988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.034179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.034591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.034873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.035868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.038017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.077281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:29.086556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de4a61-6ffc-474e-845a-d1ed90fcbdb7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.123703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.124551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.124796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.125073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.125794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:29.126105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.127511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.142223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 406/827] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:29.143055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:29.166869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 422/828] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:29.168044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:29.193482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:29.286438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a36e8-89a8-4c17-834b-859eb6719f93 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.298695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd4a0-c732-4613-ad82-27d75780a159 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.331007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.332130 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.332638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.333124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.334082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.335899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.353063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.354266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.355025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.357710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.371903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.373741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:29.390347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:29.391365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:29.392532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:29.394954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 423/829] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:29.401176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:29.467434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 407/830] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:29.498061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:29.529719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025084b-7efa-4333-89e5-b7bc262408b1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.582599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.583300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.583604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.583887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.584688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:29.585003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.586477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ac065-862f-49e6-b0c8-130e326fc652 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.600527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 424/831] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:29.607236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:29.620928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:29.739479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988e126-1aa9-4225-9aea-5093f97502af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:29.778585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:29.779496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:29.779963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:29.780243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:29.781075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:29.781389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:29.782813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18098-2009-4674-b3aa-9f26bdde2466 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:29.789424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 408/832] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:29 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:30.819062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705bbd7-d6cc-47f1-8fa2-b4311d2e39a0 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:30.819598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705bbd7-d6cc-47f1-8fa2-b4311d2e39a0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:30.819679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705bbd7-d6cc-47f1-8fa2-b4311d2e39a0 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:30.821320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 425/833] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:30.826735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:30.827186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:30.827365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:30.844953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:30.846141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:30.921481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 409/834] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:30.944508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705bbd7-d6cc-47f1-8fa2-b4311d2e39a0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.065517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705bbd7-d6cc-47f1-8fa2-b4311d2e39a0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.095242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.101488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.102282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.103092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.103575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.114404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:31.122365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:31.123462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:31.124706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 426/835] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:31.129566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.134925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.236144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12a534-618a-440e-a7ed-4a6f729e53f6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.271071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.271773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.272060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.272340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.273082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:31.273392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:31.275750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501583f4-7315-4f8b-b2d4-d72ead7ee025 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:31.284765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 410/836] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:31.290509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.376187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c92-fc7a-4b95-a07f-917cc10ca3f5 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.376490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c92-fc7a-4b95-a07f-917cc10ca3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.376753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c92-fc7a-4b95-a07f-917cc10ca3f5 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.378381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 411/837] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:31.384283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.384841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.385222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.401704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd20cf-ed1c-4859-ab4d-32d4f4670ae7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.407654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:31.408987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:31.440673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.442153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.442889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.443325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.459431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:31.461613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:31.482278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:31.483938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:31.484856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:31.485777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:31.485777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:31.485777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:31.485777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:31.488513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 427/838] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:31.495007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.503610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 412/839] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:31.523954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.551803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.631747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adec59-5393-465e-a877-9437d33af319 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.646618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d008-4901-4710-a7e2-11a13dd22f2a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.681378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.682594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.683087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.683594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.684399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.684845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:31.685192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.685478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.685755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.686003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:31.687971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:31.699127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:31.703445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 428/840] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:31.708838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:31.711579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:31.713072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:50:31.713938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:31.718276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 413/841] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:31.719165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.790666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.838537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a66f-5497-4ae1-91bb-ab73e71e4aef None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.842281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:31.850768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bacd1-b02c-4ccc-bf24-7130cf20daae None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:31.886317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.887045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.887344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.887638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.895171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:31.896660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:31.898028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:31.899746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.900258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.900745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.909126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:31.909822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:31.911911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27180fd-b91c-4875-a2d4-d27844651b7a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-29e7c3e2-870b-4633-9fc1-5d1353605f42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:31.917300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:31.918308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 06 12:50:31.919284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:31.919887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 429/842] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:31.921173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45914952-7cb9-42eb-8ea5-b222eb6753f4 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.921469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45914952-7cb9-42eb-8ea5-b222eb6753f4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.921751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45914952-7cb9-42eb-8ea5-b222eb6753f4 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.923317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 430/843] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:31.924069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45914952-7cb9-42eb-8ea5-b222eb6753f4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:31.932593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 414/844] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:31.934795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:31.935303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:31.935903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:31.953437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:31.954629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:32.026586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 415/845] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:32.027439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.044767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45914952-7cb9-42eb-8ea5-b222eb6753f4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.077098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.083990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.084976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.085485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.085989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.087437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:32.088010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.089605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.113266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 431/846] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 6 12:50:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:32.113266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.135428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.141198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16267aa-cdff-4c7a-a8e3-815353c2c54d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.178211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.179000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.179282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.179582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.189659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.191090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:32.208768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:32.209835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 416/847] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:32.210795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.218880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd074-dc6f-478e-a84a-62c7fae4ede8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.256235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.257074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.257396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.257725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.258381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.260800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-ecb41086-541e-4066-84ba-4d12ceb91b7a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:32.273049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:32.274800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:32.275817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 432/848] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:32.276715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86dfb-5583-45a6-b2ab-d3527188f89a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.276715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86dfb-5583-45a6-b2ab-d3527188f89a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.276715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86dfb-5583-45a6-b2ab-d3527188f89a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.277720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 433/849] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:32.278681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d86dfb-5583-45a6-b2ab-d3527188f89a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.324859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.328337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608448a-3b36-469d-ae17-e25e52fa244a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.360816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.361462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.361747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.362024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.365999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.382809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d86dfb-5583-45a6-b2ab-d3527188f89a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.417395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.417988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.418274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.418550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.419260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:32.419594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.420990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.432223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.432681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 434/850] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:32.433488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.433688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1be9-a02e-4239-a270-a2783048c288 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.529301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.533271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c219-1b80-459d-8af1-04a7f46b73a5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.533957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 417/851] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:50:32.536057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.536057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.536057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.551858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:32.553066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:32.568011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.568679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.568968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.569247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.569947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:32.570254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.572825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.577207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 435/852] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:32.577976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.590669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.620807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 418/853] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:32.621645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.691576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a666d9-4a6a-4824-8c78-3bf0c3279743 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.721832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed98abd-9029-4f1e-9b64-fc9c24269290 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.725298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.726106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.726394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.726673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.735397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.736866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.748241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:32.752067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:32.753082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:32.754091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:32.755685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 436/854] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:32.764529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.764529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.764773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.764876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.764876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.768519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.769982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:32.788111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:32.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:32.790295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:32.790295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:32.790295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:32.790295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:32.794322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 419/855] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:32.795208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.826274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:32.862216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602554df-5bb3-418e-9f6c-d9c0006e7c77 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.894165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b3a4d-7def-4067-8f27-d650810293a2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:32.895817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.896477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.896757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.897027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.897723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:32.898024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.900032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.905418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 437/856] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:32.906380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:32.950523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:32.951751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:32.952251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:32.953287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:32.954117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:32.956443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:32.974311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:32.975626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:32.976592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:32.977420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 420/857] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:32.978691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.029455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d897a-ad64-4293-800e-99cb6dec4835 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.032812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.062350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.068969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.070001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.070291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.070575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.072118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.072485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.074060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.094518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 438/858] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.098577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.098742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030092ba-3d3c-4230-96f2-1df32c228987 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.140170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.141245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.141245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.141566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.142364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.142743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.144227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.157819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 421/859] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.162835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.209250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f7de-1571-4d9d-b652-b8b25bec8f16 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.245341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.246018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.246304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.246582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.247289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.247625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.249010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.253673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 439/860] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.254447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.277127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0318d8-22f1-4769-81da-839e48828a9a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.280676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.313917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.314155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.314604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.314900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.315177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.368090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f043099-5990-4c81-b918-efccbcc79131 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.387386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.389495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.404468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.405392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.405583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.405824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.412743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.414176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:33.428817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:33.429789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:33.430792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 440/861] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:33.431319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.503418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 422/862] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:50:33.504628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.507746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.545081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947c6d-c59d-4531-bdb2-c0e9038d8f23 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.560078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.583587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.584265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.584552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.584832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.586040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.586167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.588338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.593088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 441/863] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.593871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.623712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe60bd-eb20-4a64-8f0e-d625a5375754 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.662834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.663568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.663862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.664139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.665072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.665388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.667098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.686429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 423/864] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.688297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.767643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baa4ea-9fd3-4073-aebc-dad2f72ab3bc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.767850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.801346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.802161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.802446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.802824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.803080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879329fb-75fa-443a-92bf-14238ccd6c0e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:33.815554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.817063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:33.835164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:33.836207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:33.838172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:33.838172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:33.838172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:33.838172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:33.838172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 442/865] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:33.843189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:33.844176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:33.845093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:33.845591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:33.846134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:33.847288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=b2ec321b639b467595aa54be55e84956) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:33.847660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:33.849097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:33.856071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 424/866] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/role_assignments?user.id=b2ec321b639b467595aa54be55e84956&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:33.877515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:33.963450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620564c-b7aa-4cd6-84a9-22dee6eb9ce0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:34.002097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:34.002776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:34.003061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:34.003335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:34.004122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:34.004429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:34.005811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:34.019157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 443/867] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:34.025279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:34.135869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b254-62c2-4eae-ba75-e9fdfc8584d8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:34.163324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:34.171837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:34.172631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:34.172914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:34.173188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:34.180310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:34.188612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:34.197356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:34.198311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:34.199250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 425/868] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:34.204308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:34.301528 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:34.316723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed3f43-2665-4b58-8a1a-5a7b177dd6c5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:34.348532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:34.349205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:34.349494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:34.349838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:34.350634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:34.351001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:34.353042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a981b-88ef-41e1-bffe-56b9ff0655bc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:34.365523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 444/869] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:34.372056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:34.479225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464c28-ef39-4d2d-bc88-8aaff91e84ab None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:34.516885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:34.517545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:34.517833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:34.518129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:34.519013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c94073eaf78b44c0b50eb85460904ffd) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:34.519333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:34.520880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0717cb-0d50-440a-a3b6-206c93bb0fb6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:34.527657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 426/870] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:34 2022] GET /identity/v3/role_assignments?user.id=c94073eaf78b44c0b50eb85460904ffd&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:35.267140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c320aa-6169-4e1c-a59e-1c5660ae6f9b None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:35.267653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c320aa-6169-4e1c-a59e-1c5660ae6f9b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:35.267653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c320aa-6169-4e1c-a59e-1c5660ae6f9b None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:35.269282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 445/871] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:35.275613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff625dba-dcb6-4093-8aef-2f895af7d462 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:35.276024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff625dba-dcb6-4093-8aef-2f895af7d462 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:35.276220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff625dba-dcb6-4093-8aef-2f895af7d462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:35.293792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ff625dba-dcb6-4093-8aef-2f895af7d462 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:35.294983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ff625dba-dcb6-4093-8aef-2f895af7d462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:35.346636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:35.367429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 427/872] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:35.391932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c320aa-6169-4e1c-a59e-1c5660ae6f9b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:35.506296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c320aa-6169-4e1c-a59e-1c5660ae6f9b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:35.543753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:35.544346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:35.544634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:35.544917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:35.545653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:35.547026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8d08b-a74a-4a4f-ad7e-ddc11f9f86fe None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:35.613005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 446/873] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:35 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:35.937673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b87-6f99-4d90-b567-6abbe87d5507 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:35.938003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b87-6f99-4d90-b567-6abbe87d5507 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:35.938220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b87-6f99-4d90-b567-6abbe87d5507 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:35.939868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 428/874] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:35.945041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f80f-f711-4d96-8a05-e2c353abda42 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:35.945335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f80f-f711-4d96-8a05-e2c353abda42 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:35.945621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f80f-f711-4d96-8a05-e2c353abda42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:35.963014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0814f80f-f711-4d96-8a05-e2c353abda42 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:35.964227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0814f80f-f711-4d96-8a05-e2c353abda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:35.967782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:36.039715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 447/875] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:36.062349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9b87-6f99-4d90-b567-6abbe87d5507 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:36.177977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9b87-6f99-4d90-b567-6abbe87d5507 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:36.214148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:36.214819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.215109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.215387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.216275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:36.217647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:36.254065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44c61-ba0b-437d-9d37-d173ba92d753 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.254397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44c61-ba0b-437d-9d37-d173ba92d753 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.254627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44c61-ba0b-437d-9d37-d173ba92d753 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.256161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 448/876] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:36.261804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.262184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.262554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.280220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:36.281396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:36.329391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 429/877] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:36 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:36.370252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 449/878] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:36.394248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:36.447352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:36.519310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa961-0121-44de-bc95-3cbd49017b5f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:36.558611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:36.559425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.559756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.560037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.560690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:36.562056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:36.574917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:36.575978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:36.576840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 430/879] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:36.582278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:36.655396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:36.702789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66ee5-3927-406f-8707-0b4f4adff068 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:36.738446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:36.739117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.739408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.739721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.740434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:36.740739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:36.742124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ff07-c72e-4385-b299-96493ff2562c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:36.748298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 450/880] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:36.753694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:36.862086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77a81-df3b-4ecc-ad4c-d117f7e866fc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:36.870540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:36.900818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:36.907197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:36.907285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:36.907611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:36.908320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:36.908636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:36.910045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbad21-68f3-4d35-beca-2c213d4ffe5d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:36.922334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 431/881] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:37.048932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be527b-eac2-4121-85f8-425f479c7fcf None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.049132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be527b-eac2-4121-85f8-425f479c7fcf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.049407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be527b-eac2-4121-85f8-425f479c7fcf None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.051286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 451/882] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:37.057556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.058159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.058660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.078595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:37.080236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:37.156089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 432/883] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:37.182231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be527b-eac2-4121-85f8-425f479c7fcf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:37.291451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be527b-eac2-4121-85f8-425f479c7fcf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:37.318396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:37.328155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:37.328975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.329258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.329537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.340744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:37.349003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:37.351229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:37.352892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 452/884] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:50:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:37.356512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:37.457094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:37.460611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055c1b-657d-4af9-b717-da89428bff71 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:37.503318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:37.504022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.504305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.504582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.505327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:37.505692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:37.507107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:37.516987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 433/885] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:50:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:37.522475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:37.629064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1919bba-c6fd-4419-9bda-2680d25ac0f4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:37.664968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:37.665916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.666209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.666490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.677760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:37.679269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:37.697303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:37.698265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:37.699271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:37.699271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:37.699271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:37.699271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:37.699271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 453/886] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:37.704049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:37.815834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6879-6506-4d7a-9720-59be9d39b149 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:37.851352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:37.852088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:37.852366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:37.852636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:37.853350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:37.853654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:37.855009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:37.867165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 434/887] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:37.872642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:37.929857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:37.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63af2d-6e80-4acd-88ae-8f8d2655b134 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.030182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.031000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.031289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.031591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.039128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.041478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-af8d743a-da28-446e-bad0-cc10568d37a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:38.057005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:38.058009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:38.058954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 454/888] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:38.065799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.088307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c3bf-90f1-4027-a4eb-c5b6cbdf6bb2 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.088613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c3bf-90f1-4027-a4eb-c5b6cbdf6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.088880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8c3bf-90f1-4027-a4eb-c5b6cbdf6bb2 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.090597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 455/889] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:38.093476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.095731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.097712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.097712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.114795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:38.116308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:38.180538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15c98-e5e7-430a-99b4-01dfe988b3ba None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.199636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 456/890] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:38.217177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.217980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.218753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.219135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.219509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.220603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:38.221034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.222656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.242248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 435/891] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:38.248349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.250669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.338409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912516e-7135-414d-a684-fb30d1ee5759 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.345518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.371474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f876-81c9-4b35-94a7-879c36f357fd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.378309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.379387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.379900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.380385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.381324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.383050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:38.396010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:38.397107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:38.397986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:38.408301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 457/892] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:38.410684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.410995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.411802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.412089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.412366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.495471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.497362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.531030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.545541 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8389d7-27d6-4b5f-a22e-31c3e1d20b6b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.588116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.589191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.589705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.590338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.591500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.592464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:38.592983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.594611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.605422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 458/893] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:38.606963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.612723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 436/894] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 12:50:38.619792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.721503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-8b79-4713-b080-6506a9787e3e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.757111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b68aa-9b36-406a-aa8d-bb1b5cfce7ee None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.760145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.761618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.761910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.762194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.762910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:38.763220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.764627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df14a0-8ec2-4eb2-974e-0fabea3f94c1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.775445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 459/895] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:38.775445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9d55-d3b6-4c56-ac5a-19e69276ef85 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.775445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9d55-d3b6-4c56-ac5a-19e69276ef85 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.775445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9d55-d3b6-4c56-ac5a-19e69276ef85 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.775833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 460/896] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:38.777184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba9d55-d3b6-4c56-ac5a-19e69276ef85 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.799820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.800151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.800950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.801233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.801504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.812059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.817960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b7a726cf-f23a-4c75-b84d-7b012d127ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:38.831966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:38.832956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:38.833998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:38.833998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:38.833998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:38.833998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:38.837974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 437/897] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:38.839242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.839553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.839835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.856840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:38.858137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:38.886123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:38.888131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba9d55-d3b6-4c56-ac5a-19e69276ef85 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:38.935708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:38.936354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:38.936637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:38.936910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:38.943570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 438/898] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:38.943719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] RBAC: Adding query filter params (interface=public, service_id=a5bddd25fdea4b1aae1cc6a7baddbc35, region_id=RegionOne) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:38.943719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:38.943883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:38.943959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:38.953371 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 461/899] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/endpoints?service_id=a5bddd25fdea4b1aae1cc6a7baddbc35&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:38.958795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.049529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63619410-3c11-4565-bd25-8346bb7904fd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.054298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.072071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8fac-11e5-4780-b9b6-067068d9f7db None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.083459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.086934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.086934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.086934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.086934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.086934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.087917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.103794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 439/900] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.103794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.115365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.116054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.116349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.116757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.118065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.119445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.125213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 462/901] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:38 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 12:50:39.126007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.138247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.236205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc208c4-ed51-44b1-8cd2-a95c234e5782 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.278222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3036-61ee-4a51-9992-7e8ae7b0a338 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.289051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.290870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.291636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.292092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.292943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.295668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:39.312754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:39.313902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:39.314776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:39.319042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 440/902] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:39.320040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.323511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.325288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.325579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.325887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.334801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.336330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c062b5aa-c283-40e7-8d5a-699c46dcf71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:39.352923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:39.354299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:39.355202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 463/903] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:39.355806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0482fff-da87-46ea-b425-df6bbb072e04 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.355806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0482fff-da87-46ea-b425-df6bbb072e04 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.356405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0482fff-da87-46ea-b425-df6bbb072e04 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.357453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 464/904] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:39.362193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0482fff-da87-46ea-b425-df6bbb072e04 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.375221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.420757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.441358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c35db-ce56-44da-843f-e7d549bb754e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.477673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.478391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.478624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.478933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.479559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0482fff-da87-46ea-b425-df6bbb072e04 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.479681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.479921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.481458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c4dc-4d04-421d-aee4-79b3f298bb3f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.491443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 441/905] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.492967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.493261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.493548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.511268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:39.512493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:39.517788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.518448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.518730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.519002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.519813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.520120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.521561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.533937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 465/906] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.535027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.598426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 442/907] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:39.599579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.604023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.642455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a8c90-b948-4acc-b4d6-68cb5d787e3f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.679199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.680324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.680611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.681000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.681697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.682000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.683355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.693128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 466/908] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.693128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.700952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.720890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c2f8c-f1df-4012-8288-4a9ac44fd1d2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.756279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.756931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.757216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.757493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.758919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] RBAC: Adding query filter params (role.id=5b97e79949f543939ea5776757113aaa, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c94073eaf78b44c0b50eb85460904ffd) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.759231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.760710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.766194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 443/909] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/role_assignments?user.id=c94073eaf78b44c0b50eb85460904ffd&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=5b97e79949f543939ea5776757113aaa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.766970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:39.816779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15ae8c-a591-4a77-9b73-63774f2836b5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.853187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:39.858807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.864807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.864807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.864807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.864807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.864807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.921452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b3505-c938-4602-b9a0-bd581419d0b2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:39.940079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 467/910] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:39 2022] POST /identity/v3/services => generated 241 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:39.974716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:39.975452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:39.975773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:39.976049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:39.977552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] RBAC: Adding query filter params (interface=public, service_id=fa9f0923c6ff436dbf1c1f2331288828, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:39.977892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:39.979496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994526b-3125-4f39-9d0f-e8d311b529e1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:39.986145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 444/911] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/endpoints?service_id=fa9f0923c6ff436dbf1c1f2331288828&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:39.992170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:40.105903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e4e75-2160-4f46-8451-d4bec3f6e5c3 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:40.143318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:40.144020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:40.144302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:40.144628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:40.145389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:40.146755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d18f3-7769-48d6-baab-0c778b7f05fb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:40.153651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 468/912] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:39 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 12:50:41.468058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708e86-7e46-4ebf-bcc6-2e19c3467b1b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:41.468582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708e86-7e46-4ebf-bcc6-2e19c3467b1b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:41.468661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708e86-7e46-4ebf-bcc6-2e19c3467b1b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:41.470374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 445/913] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:41.475717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:41.476584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:41.477099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:41.495103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:41.496667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:41.556086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:41.573178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 469/914] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:41.595753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708e86-7e46-4ebf-bcc6-2e19c3467b1b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:41.601115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:41.714445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708e86-7e46-4ebf-bcc6-2e19c3467b1b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:41.751012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:41.751778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:41.752058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:41.752324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:41.752971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:41.754337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:41.766869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:41.767978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:41.768890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 446/915] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:41.776725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:41.887550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bb0e-d189-4d3a-812e-088bcda623f2 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:41.934268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:41.934960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:41.935248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:41.935554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:41.936275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:41.936584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:41.937993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:41.943902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 470/916] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:41.949898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.021003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.061972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b673-09dd-4b20-b1d3-71c4bbea6131 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.097273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.097937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.098273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.098556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.099259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:42.099585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.100947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ab43-dbad-4fcc-8df8-d53b1c15ac07 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.106813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 447/917] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 6 12:50:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:42.112342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.167415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.170414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288e3c-ee3c-474d-b5a4-6dd83fe1ade3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.170831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288e3c-ee3c-474d-b5a4-6dd83fe1ade3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.171207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288e3c-ee3c-474d-b5a4-6dd83fe1ade3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.173057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 448/918] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:42.178155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4d8a-db03-4c3e-85b1-f9c7b5967704 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.186151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4d8a-db03-4c3e-85b1-f9c7b5967704 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.186151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4d8a-db03-4c3e-85b1-f9c7b5967704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.203416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2b6b4d8a-db03-4c3e-85b1-f9c7b5967704 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:42.203416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2b6b4d8a-db03-4c3e-85b1-f9c7b5967704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:42.227555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b98c-afb2-4405-adf1-76bf6d0b23d1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.265796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.266509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.266774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.267055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.267864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.269282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.289433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 449/919] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:42.290859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ad8db-a258-4897-b2f0-c933ecb4866d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.291151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ad8db-a258-4897-b2f0-c933ecb4866d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.291426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ad8db-a258-4897-b2f0-c933ecb4866d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.292768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 450/920] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:42.298016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.298303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.298715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.315831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:42.317002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:42.348653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 471/921] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:42.349751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.390106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.414602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 451/922] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:42.437973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.472300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6b34e-c45e-4a18-9134-e46f23d228a5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.481765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.511456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.512358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.513046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.513570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.526467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:42.535231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:42.536333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:42.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:42.541932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 472/923] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:42.544093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.588456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573a61-6928-4acc-93e4-3106403ec543 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.629173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.630403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.630403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.630628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.631568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.632710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7b4b02c9-3345-4833-8803-f5607c043f5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:42.646226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:42.647283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:42.648597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 452/924] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:42.649421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1baa-8004-4280-8e61-89b6963d7840 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.649421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1baa-8004-4280-8e61-89b6963d7840 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.649421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1baa-8004-4280-8e61-89b6963d7840 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.650569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 453/925] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:42.654161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1baa-8004-4280-8e61-89b6963d7840 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.666491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab62a-70c4-4299-94c1-0c090b43c0d5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.701514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.702187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.702469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.702746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.703495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:42.703835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.705192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404316e-4d7c-4bec-b87b-d8e7e4b51a1e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.714581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 473/926] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:42.715645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.720549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.720847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.721132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.740288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:42.741489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:42.766174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.769917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1baa-8004-4280-8e61-89b6963d7840 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.808160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.808746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.809030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.809304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.810107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:42.810418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.811799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.815556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 474/927] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:42.816582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.821173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 454/928] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:42.822029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.937117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb4f0-9312-407b-811f-e2849120de18 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.944271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30824-e803-47ee-8fa4-459f6203e4bf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:42.958843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:42.980605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.980835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:42.981277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.981383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:42.981577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.981672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:42.981825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.981917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:42.982709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:42.983021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.984482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:42.994413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 455/929] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:42.994413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:42.996999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:42.998517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:43.016603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:43.017557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:43.018492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:43.018492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:43.018492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:43.018492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:43.018492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 475/930] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:43.018771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.031685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.106185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec0aaf-9e17-4aa4-80c7-95fff3977b10 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.124160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e675c5a-19bc-46a1-be81-80b87bd65125 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.142377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.143240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.143540 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.143847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.144494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.145948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:43.158441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:43.159412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:43.160644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 456/931] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 6 12:50:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:43.161520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.167941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.168611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.168895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.169172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.169962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] RBAC: Adding query filter params (interface=public, service_id=4e908ec13f894719ae4f14fde4eec54f, region_id=RegionOne) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:43.170274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.171670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.177900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 476/932] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/endpoints?service_id=4e908ec13f894719ae4f14fde4eec54f&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:43.178502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.212756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.255442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.271806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de4cb4-b2dd-4878-9161-0834d62cd82f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.280900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d609dc-d8c5-4ecf-8a74-27d4e95b33e6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.308111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.309020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.309454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.309953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.310797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:43.311248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.312791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.317420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.318082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.318366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.318643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.319398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:43.319749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.321842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.329734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 457/933] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:43.329734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.330055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 477/934] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:43.330693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.433759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6386121-2322-4e77-9aa2-57446a0940f7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.436531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcf2d2-4bf1-45dd-bbdc-76d133b35f30 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.436866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.467842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.468499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.468782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.469053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.469719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.471071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.472422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.473307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.473598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.473871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.487579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 458/935] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 12:50:43.487579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.489776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.491413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.494156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:43.508809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:43.509892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:43.510871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:43.515353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 478/936] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:43.516605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.616149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07476-ade4-4a35-b045-ef7c757c8ba3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.633662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9545ec3-ac51-4311-b484-44d3d92ee9f6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.670990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.672113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.672709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.673142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.674211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:43.674437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.674893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.675233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.675713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.676050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.676908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:43.677208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.677322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.678770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.685814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 459/937] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:43.695647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.704831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 479/938] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:43.710129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.739115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.790916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:43.830290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f64e-e392-4b51-82d3-a1205b76aff4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.830496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc7a1-95ea-4680-8edb-b5e9ed5b3d9f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:43.865728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.866703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:43.867594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.868058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.868218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:43.868595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:43.868753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.869062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:43.869901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.871352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.881674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:43.883385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:43.901407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:43.902805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:43.903766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:43.903766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:43.903766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:43.903766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:43.906620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 480/939] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:43.911741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:43.971950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 460/940] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:44.034348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c741-75ea-4df1-ae04-833ecf58687b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:44.046527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:44.083228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:44.084442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.084940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.085465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.087098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:44.087775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:44.089745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:44.106043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 481/941] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:44.113872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:44.211365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:44.228381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406dc75-9c70-4325-8e18-79c8e8c84363 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:44.265905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:44.266709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.266995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.267278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.274737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:44.276226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:44.291560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:44.292697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:44.293815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:44.295916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 461/942] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:44.302959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:44.408358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae0cc-ed2f-4918-824f-351cc996eb57 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:44.450386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:44.451072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.451359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.451728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.452539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:44.452852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:44.454334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16339fa1-bf5d-4c3a-ac30-7c7058833902 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:44.468675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 482/943] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:44.474481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:44.581149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4142e9-d8d5-4b20-824f-85106affeb27 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:44.617352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:44.618995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.619423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.619892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c94073eaf78b44c0b50eb85460904ffd/roles/5b97e79949f543939ea5776757113aaa` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.622233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=c94073eaf78b44c0b50eb85460904ffd, role_id=5b97e79949f543939ea5776757113aaa)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:44.623835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c6fb-6b5e-40e5-b318-18c31c1e0482 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:44.702929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 462/944] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:50:44 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/c94073eaf78b44c0b50eb85460904ffd/roles/5b97e79949f543939ea5776757113aaa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:50:44.803520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9025c1b-8e2c-4525-8935-eeb29eb18a42 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.804113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9025c1b-8e2c-4525-8935-eeb29eb18a42 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.804113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9025c1b-8e2c-4525-8935-eeb29eb18a42 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.806976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 483/945] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:44.813172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:44.813470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:44.813754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:44.832673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:44.833843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:44.837144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:44.920770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 463/946] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:44.947491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9025c1b-8e2c-4525-8935-eeb29eb18a42 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:44.976817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:45.057573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9025c1b-8e2c-4525-8935-eeb29eb18a42 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:45.093201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:45.094082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:45.094538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:45.094969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:45.095860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:45.097505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:45.099031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING keystone.server.flask.common [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 06 12:50:45.141904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.sql.core [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 12:50:45.141904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 12:50:45.141904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [parameters: {'id': '0361d7bf611b49df9f2e1bdf113e13ce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 12:50:45.141904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0361d7bf611b49df9f2e1bdf113e13ce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0361d7bf611b49df9f2e1bdf113e13ce. Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:50:45.161169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result.read() Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 06 12:50:45.162266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application yield resource Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise self.value Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application session.commit() Jun 06 12:50:45.163514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.session.flush() Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application compat.raise_( Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 12:50:45.164761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 12:50:45.166155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result.read() Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:50:45.167216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [parameters: {'id': '0361d7bf611b49df9f2e1bdf113e13ce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:45.168203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:45.169073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0361d7bf611b49df9f2e1bdf113e13ce. Jun 06 12:50:45.170206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:45.172865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 484/947] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Jun 6 12:50:44 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:45.178995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:45.285919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea739a-20f5-4d9d-880f-bad16c8cdfb1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:45.321308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:45.322276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:45.322661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:45.323048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:45.330316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:45.331897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:45.333753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-144b07ae-bf5d-470a-9187-b1f826452d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:45.349334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:45.350301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:45.351925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 464/948] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:45.354363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:45.442815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:45.463191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851effa2-4332-4f20-a3a6-f57bb45234a8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:45.498975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:45.500028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:45.500514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:45.501097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:45.502061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:45.502565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:45.504501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fbe0-8eee-40d8-95d1-a66668804fe3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:45.528556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 485/949] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:45.873110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d3e5-94d4-4e74-8b1b-0b92bf371bc4 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:45.874109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d3e5-94d4-4e74-8b1b-0b92bf371bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:45.874605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d3e5-94d4-4e74-8b1b-0b92bf371bc4 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:45.876482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 465/950] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:45.882042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:45.883242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:45.883242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:45.901343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:45.903115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:45.979677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 486/951] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:45.997411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d3e5-94d4-4e74-8b1b-0b92bf371bc4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.109530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d3e5-94d4-4e74-8b1b-0b92bf371bc4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.148094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.149112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.149400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.149676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.150328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.151813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:46.165219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:46.167252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:46.168182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 466/952] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:46.175668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.249114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:46.280579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a12b4-64c3-4c9b-904e-e24c6401776b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.316317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.316988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.317326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.317604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.318357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:46.318671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.320207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d265d-4b8b-4a70-8c4d-d626b8e6df3b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.325737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 487/953] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:46.332591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.392043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a339b9-f17d-4b64-bf91-15b2551d9e46 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.392381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a339b9-f17d-4b64-bf91-15b2551d9e46 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.392611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a339b9-f17d-4b64-bf91-15b2551d9e46 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.394991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 488/954] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:46.400192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.400679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.400679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.411953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:46.421506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:46.423090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:46.441879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e20b-484f-42f3-8c0b-238a9bf2284b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.477718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.478590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.478987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.479411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.480210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:46.480621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.482093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.492297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 467/955] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:46.494266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.509008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 489/956] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:46.533121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.612100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:46.617626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69d955-4da3-48dc-9150-33c27dfa9401 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.649767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:46.660156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.661102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.661570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.662013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.662969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.665427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.667430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ff51-cefd-442d-a519-61bad72a3b3c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.705394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.706192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.706473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.706746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.707487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.708851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:46.721862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:46.722954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:46.732032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 490/957] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:46.732920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:46.748149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 468/958] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:46.860071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0475dbc-c232-4ba8-88c5-7e226a90aa11 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:46.902494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:46.918149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:46.918832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:46.920260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:46.920260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:46.920260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:46.920507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:46.922939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a74372-5d4e-499f-b298-ca529ab3387d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:46.931661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 491/959] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:46.934236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:47.044836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b6c00-ebb4-4b18-ab5a-709ead2a93a5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:47.090412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:47.091080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.091366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.091699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.092382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:47.092695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:47.094054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc76d7-4ef9-40c5-97fa-25c51abbdd53 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:47.103667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 469/960] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:47.206984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89038-0d2f-49ad-b445-87f10e2879e5 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.207189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89038-0d2f-49ad-b445-87f10e2879e5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.207465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89038-0d2f-49ad-b445-87f10e2879e5 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.209297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 492/961] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:47.216182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.216479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.216755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.235687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:47.236920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:47.286811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:47.313308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 470/962] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:47.340218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89038-0d2f-49ad-b445-87f10e2879e5 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:47.449956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89038-0d2f-49ad-b445-87f10e2879e5 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:47.486198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:47.486985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.487283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.487585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.499418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:47.509374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:47.510366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:47.511245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 493/963] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:50:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:47.516610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:47.625542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fab5f3-2627-4dce-9e61-17c2ba6d5e0e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:47.664469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:47.665142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.665426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.665701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.666441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:47.666748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:47.668144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:47.676666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 471/964] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:50:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:47.682546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:47.733103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:47.785939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e84bb-6b7d-4c2c-a259-3814669bdc07 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:47.819487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:47.820839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.821126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.821401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.832217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:47.833664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-0f8256c4-814e-44f5-973e-4be9334cfcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:47.851389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:47.852457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:47.853358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:47.853358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:47.853358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:47.853358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:47.853358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 494/965] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:47.858769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:47.899157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:47.955469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff267f7-93aa-4459-897e-eef1412683f6 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.956043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff267f7-93aa-4459-897e-eef1412683f6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.956043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff267f7-93aa-4459-897e-eef1412683f6 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.957674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 495/966] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:47.962982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:47.963274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:47.963583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:47.968760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaa86e-5091-448e-9b0c-d9d5e762c308 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:47.980412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:47.981607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:48.011065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.012405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.012904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.013852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.015087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:48.015650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.018222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.037672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 472/967] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:48.039862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.071564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 496/968] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:48.098139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.133999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.173292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f1932-7455-4100-98d7-71ca1309f07d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.175889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.210062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.211971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.212515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.213018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.221814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.224257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.225062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afecfe4-67fd-4798-bf3d-cec908aef64c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:48.247398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:48.248469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 06 12:50:48.249457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:48.253917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 473/969] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:48.254885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.269976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.271056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.271587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.272061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.273536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.275302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.323604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.sql.core [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 12:50:48.323604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 12:50:48.323604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [parameters: {'user_id': 'c712e44ba46442e78c3f556a8f0fe8e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 12:50:48.323604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result.read() Jun 06 12:50:48.334609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:50:48.351468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application yield resource Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application next(self.gen) Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise self.value Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application session.commit() Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 12:50:48.352567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.session.flush() Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application compat.raise_( Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 12:50:48.353500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 12:50:48.355314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application conn.query(q) Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application result.read() Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 12:50:48.357494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c712e44ba46442e78c3f556a8f0fe8e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:48.359461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 06 12:50:48.361355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 497/970] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 6 12:50:48 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:48.368255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.372607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9170005-df86-4cc7-b0c7-69eadc4a08b6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.411622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.412330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.412618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.412912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.414544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:48.414859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.416665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.440335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 474/971] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:48.441229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.460634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.462164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.471257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1ce4-f62c-4270-ad1d-41fd5b4b52c6 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.509643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.510954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.511438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.511937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.519939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.521936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:48.537813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:48.539773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 12:50:48.540728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.547849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 498/972] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:48.548945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeb44-140c-4ea0-9590-fa2c2a528b5a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.549062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.587122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.587731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.588023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.588304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.656210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004824de-f93c-491a-8c49-acb62f6ac0a2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.665089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.666308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.685046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.693505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.694123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.695188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.695690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.696601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:48.697009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.698529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.747914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 499/973] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:48.780169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 475/974] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:50:48.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:48.804566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:48.909689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe007-31a2-4746-85fd-c935a278692b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:48.946673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:48.947481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:48.947796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:48.948071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:48.959627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:48.961805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:48.981346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:48.982344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:48.983274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:48.983274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:48.983274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:48.983274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:48.983274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 500/975] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:48.989710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.111002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48899-98a4-4f6c-83a2-2d93cdbad270 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.129281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.147340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.148301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.148590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.148861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.149569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:49.149873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.151329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51cdc0-f1b5-4d32-b3af-207b7c38902f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.164899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 476/976] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:49.170704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.221593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17ad6-34ed-4bf3-957b-0a210d1868d5 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.222340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17ad6-34ed-4bf3-957b-0a210d1868d5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.222637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17ad6-34ed-4bf3-957b-0a210d1868d5 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.224551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 477/977] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:49.230462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.230754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.231036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.242763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.252446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:49.257533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:49.288031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7131f7-0d07-44b3-9aad-1a992af42fb8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.328099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.328896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 478/978] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:49.329019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.329186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.329477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.337143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.338596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.351584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:50:49.353433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:49.354344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:50:49.355288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:49.360146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 501/979] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:49.361994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.455296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69619d1f-5c2a-44f2-90f1-c41d4cbf6866 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.463056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.468328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798546-d723-4654-a9cc-3f636a2e2359 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.491887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.492972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.493258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.493532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.494189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.494321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.495598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.506254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.507271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.507474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.507818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:49.507910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:49.508861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:49.514958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:49.516271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:49.516271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.516412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 479/980] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:49.516483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.516552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.527865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 502/981] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:49.530254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.616987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5e0fa-a695-4d52-afd7-fdec6f2f5943 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.628212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32d1e9-ba73-428e-94f6-80b856bc186e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.650422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.651088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.651370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.651680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.652629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:49.652932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.654300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f27e9-a1aa-4603-ae37-9f4ab11fbdd8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.663580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 480/982] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:49.663580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d3d0-1880-4229-9c25-feb90d1e01d5 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.663580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d3d0-1880-4229-9c25-feb90d1e01d5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.663580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d3d0-1880-4229-9c25-feb90d1e01d5 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.663580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 481/983] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:49.664508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d3d0-1880-4229-9c25-feb90d1e01d5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.668983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.669641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.669926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.670203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.671043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] RBAC: Adding query filter params (role.id=5b97e79949f543939ea5776757113aaa, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=c94073eaf78b44c0b50eb85460904ffd) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:49.671355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.672814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b4944-211b-4dc3-b202-22b99ed6fd07 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.695004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 503/984] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/role_assignments?user.id=c94073eaf78b44c0b50eb85460904ffd&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=5b97e79949f543939ea5776757113aaa => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:49.695004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.695004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.695004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.699599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:49.701211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:49.702588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.751223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.791564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 504/985] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:49.793795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d3d0-1880-4229-9c25-feb90d1e01d5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.806099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.835196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.836366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.836730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.837084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.837887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:49.838267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.839782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:49.846672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 482/986] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:49.853099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:49.928525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0da35-525d-4f83-b678-be6ddf59a5aa None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.964635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:49.968131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:49.968705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8045d-4e98-4d8a-a71e-67baebb963b7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:49.968813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:49.969088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:49.969370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:49.970153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:49.971612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd60798-be9a-4e5d-b4b0-757d96fccda8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:50.002408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:50.003011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:50.003300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:50.003606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:50.004405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] RBAC: Adding query filter params (interface=admin, service_id=4e908ec13f894719ae4f14fde4eec54f, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:50.004723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:50.006094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:50.012312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 483/987] 10.222.0.13 () {56 vars in 1249 bytes} [Mon Jun 6 12:50:49 2022] GET /identity/v3/endpoints?service_id=4e908ec13f894719ae4f14fde4eec54f&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:50.017477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:50.068301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 505/988] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:49 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:50:50.134261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cff31-a3a1-4512-a856-40644b3ef1e6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:50.179485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:50.180193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:50.180474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:50.180744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:50.181432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:50.182851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a583e2-a503-4bde-a81b-d8a46162bda5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:50.189968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 484/989] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:50 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 12:50:51.997497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129c0d-fdb0-4a3c-a59e-b2de611f9c0c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:51.998014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129c0d-fdb0-4a3c-a59e-b2de611f9c0c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:51.998095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d129c0d-fdb0-4a3c-a59e-b2de611f9c0c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:51.999472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 506/990] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:52.004730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.005161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.005370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.024245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:52.025510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:52.045812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.097550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 485/991] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:52.121197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d129c0d-fdb0-4a3c-a59e-b2de611f9c0c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.161719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.230490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d129c0d-fdb0-4a3c-a59e-b2de611f9c0c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.265342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.266138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.266422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.266693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.267344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.268740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-f2c0a28a-38a4-474b-8a2d-0ea80d2080b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:52.280707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:52.281802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:52.282658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.284190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 507/992] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:52.288428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.367561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00e478-64bf-40e8-9bb6-76015e29f176 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.367914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00e478-64bf-40e8-9bb6-76015e29f176 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.368145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00e478-64bf-40e8-9bb6-76015e29f176 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.369638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 508/993] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:52.374491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702325-a557-4694-9038-2cc35b0da5b5 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.374779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702325-a557-4694-9038-2cc35b0da5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.375051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702325-a557-4694-9038-2cc35b0da5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.392620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4a702325-a557-4694-9038-2cc35b0da5b5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:52.393783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4a702325-a557-4694-9038-2cc35b0da5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:52.399210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e81fbc-f5b9-4f69-848f-efefc49d5aa5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.435984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.436574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.436857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.437134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.437827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] RBAC: Adding query filter params (name=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:52.438137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.439642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.450635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 486/994] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:52.451687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.465365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 509/995] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:52.466756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19aa4-47cb-4c7c-88fe-aa5d1771eeb0 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.467055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19aa4-47cb-4c7c-88fe-aa5d1771eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.467343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19aa4-47cb-4c7c-88fe-aa5d1771eeb0 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.468648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 510/996] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:52.471439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.473732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.474024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.474305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.492289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:52.493603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:52.518077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.556672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b453a7-2cfc-4c9d-9458-fd600804a6af None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.561559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 511/997] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:52.562379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.597368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.598025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.598308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.598581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.599275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] RBAC: Adding query filter params (type=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:52.599610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.601088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.605495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 487/998] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:52.606310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.670485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aada1b-6948-4c00-b1a6-9d12f21869ed None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.702449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.709967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.710894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.711243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.711544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.714151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.714151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.723163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f4849-fe74-4451-9a41-e8e424a90905 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:52.726982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:52.728233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:52.729115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:52.731873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 512/999] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:52.734592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.764055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:52.767861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.768680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.768961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.769236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.769892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.771348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:52.784792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:52.786108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:52.787131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 488/1000] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:52.793271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.857189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d851ec-1c96-4547-a99f-c5d377767abf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.891929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.892603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.892890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.893176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.893892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:52.894203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.895606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.907159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 513/1001] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:52.907790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.913242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862194d4-dfd6-4711-b4c1-521469e6efb0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:52.953084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:52.954029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:52.954463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:52.955001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:52.955881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:52.956336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:52.958069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:52.964608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 489/1002] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:52.969800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:52.981976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:53.008230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:53.020483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7561-f53b-4717-aa42-08f513e0dac2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:53.059596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:53.060419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:53.060712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:53.060990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:53.062172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:53.062449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:53.063808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:53.068892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 514/1003] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:53.074784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:53.081516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc85b3-0dd6-4aeb-ba4b-6ce9f5e28507 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:53.121329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:53.122011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:53.122500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:53.122610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:53.123268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:53.123861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:53.124973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:53.130275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 490/1004] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 6 12:50:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:53.136180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:53.184606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdf44e-a87c-4fa2-a477-1fac79f60f1a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:53.213721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:53.221430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:53.222105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:53.222401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:53.222649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:53.223429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] RBAC: Adding query filter params (interface=public, service_id=90a11a5e7a1d462baaed1fcbbab98d92, region_id=RegionOne) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:53.223771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:53.234812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:53.234812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 515/1005] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:53 2022] GET /identity/v3/endpoints?service_id=90a11a5e7a1d462baaed1fcbbab98d92&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:53.236347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:53.244986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4960b33-a1bb-4ed0-9013-c8fd7d765cd4 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:53.254092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:53.285257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:53.285924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:53.286211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:53.286487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:53.287226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:53.289300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289f54-1640-4de3-923e-cffb3f396fc1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:53.339688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9bda-a2c3-4d7a-a16c-4037829b59fd None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:53.360313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 491/1006] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:50:53.419937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:53.419937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:53.419937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:53.419937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:53.420797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:53.420797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6910434-3168-488e-bcbd-4efff8860d27 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:53.420797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 516/1007] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:53 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 12:50:54.880317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86217c-f72a-4734-b6e3-03fbf14fa33e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:54.880838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86217c-f72a-4734-b6e3-03fbf14fa33e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:54.880917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86217c-f72a-4734-b6e3-03fbf14fa33e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:54.882444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 492/1008] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:54.887552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129773-6f73-4431-8277-a92ac5217ac3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:54.887966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129773-6f73-4431-8277-a92ac5217ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:54.888166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129773-6f73-4431-8277-a92ac5217ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:54.906519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5b129773-6f73-4431-8277-a92ac5217ac3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:54.908561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5b129773-6f73-4431-8277-a92ac5217ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:54.979570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 517/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:55.001424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86217c-f72a-4734-b6e3-03fbf14fa33e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:55.106635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86217c-f72a-4734-b6e3-03fbf14fa33e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:55.136854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:55.142330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:55.142999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.143286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.143586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.144398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:55.149557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d6bc1-c697-46c4-a8a1-25e0a35b3cc4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:55.256267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 493/1010] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:55 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:55.695995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9d7c-4767-41a5-b0be-55c94a3eaefa None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.696351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9d7c-4767-41a5-b0be-55c94a3eaefa None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.696559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9d7c-4767-41a5-b0be-55c94a3eaefa None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.697978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 518/1011] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:55.702680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.702880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc28a-0f27-460b-8c18-17b4b0893f0d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.702990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.703149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc28a-0f27-460b-8c18-17b4b0893f0d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.703260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.703420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc28a-0f27-460b-8c18-17b4b0893f0d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.704815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 494/1012] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:55.710117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.710404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.710685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.715836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:55.721645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:55.723293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:55.728162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:55.729327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:55.804798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 519/1013] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:55.807489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 495/1014] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:55 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:55.828700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:55.831251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:55.939270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02343-6e4c-4024-8ae2-13e714a30ba2 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:55.950372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cd2f-7ca9-49d8-9eb3-9060e243b3c4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:55.969628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:55.970225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:55.976430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:55.977242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.977530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.977814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.978471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:55.979861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:55.988460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:55.989250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:55.989532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:55.989807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:55.991223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:55.992705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:55.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:55.993901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 12:50:56.000146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:56.000919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 496/1015] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:56.000993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 520/1016] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:50:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:56.001062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:56.001570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:56.108256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771670f6-41e0-4fff-ac80-8343bbb5770b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:56.115914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543bd02-5c09-4333-8e53-dabc849578ff None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:56.145450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:56.146099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:56.146380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:56.146656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:56.147608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:56.149036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:56.152452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:56.153187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:56.153625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:56.153744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:56.154439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:56.154751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:56.156128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:56.161920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 521/1017] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:56.168069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:56.228501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:56.233995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 497/1018] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:50:55 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:56.273915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee60637-fe66-479e-ade7-de2931fae686 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:56.312489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:56.313171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:56.313463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:56.313745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:56.314461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:56.314770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:56.316208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09834b0d-8866-417a-a6c6-af85fadb7a5f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:56.326715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 522/1019] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 6 12:50:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:56.328309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:56.373942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:56.442760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7da8af-7b20-442c-9cee-bceb0862fee0 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:56.481411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:56.481996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:56.482276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:56.482548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:56.483272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:56.484664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaf186-e134-476f-a411-051e1de3d29a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:56.559449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 498/1020] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:50:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:50:57.612480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea2f5-e457-42e7-ab82-b026edd558fd None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:57.613205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea2f5-e457-42e7-ab82-b026edd558fd None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:57.613205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea2f5-e457-42e7-ab82-b026edd558fd None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:57.614554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 523/1021] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:57.619879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:57.620353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:57.620509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:57.638663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:57.640776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:57.721852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 499/1022] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:50:57.745630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea2f5-e457-42e7-ab82-b026edd558fd None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:57.858005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea2f5-e457-42e7-ab82-b026edd558fd None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:57.881694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:57.892647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:57.893441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:57.893727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:57.894005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:57.894668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:57.896049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:57.908363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:57.909372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:50:57.910270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 524/1023] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 6 12:50:57 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:57.916437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:57.943846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:58.023713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026c413-c44b-4ace-b866-57069b53fc85 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.058517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.059183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.059469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.059770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.060468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] RBAC: Adding query filter params (name=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:58.060774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.062135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:58.067128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 500/1024] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:58.072976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:58.175452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b28d-a156-480e-85d2-0fee9ff5a0b5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.211875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.212569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.212856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.213133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.213861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] RBAC: Adding query filter params (type=image) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:58.214174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.215691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:58.226925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 525/1025] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:58.228323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:58.317515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:58.334976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6aee2-d1fe-4d59-8ca4-d8abcdbd7803 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.370000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.370657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.370945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.371222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.372035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] RBAC: Adding query filter params (interface=public, service_id=49d59b9f83434605992c01203c993c87, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:58.372351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.373727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49cea-0eb4-44b6-9836-f38668013205 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:58.383977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 501/1026] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:50:58 2022] GET /identity/v3/endpoints?service_id=49d59b9f83434605992c01203c993c87&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:58.385674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:58.442053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:58.491263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457c28-a0d2-43ae-b9ce-900a5d938730 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.525836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.526516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.527064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.527344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.528058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.529439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8348ae0-0f22-41f6-9549-e8a9ba6c762f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:58.538846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc2f25-91cf-4c1e-88ce-25d74e9964a9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.539147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc2f25-91cf-4c1e-88ce-25d74e9964a9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.539416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc2f25-91cf-4c1e-88ce-25d74e9964a9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.539683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 526/1027] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:50:58 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 12:50:58.540970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 502/1028] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:50:58.546582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a767b-4b02-4295-9249-007813cba120 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.546892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a767b-4b02-4295-9249-007813cba120 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.547161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a767b-4b02-4295-9249-007813cba120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.566466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-648a767b-4b02-4295-9249-007813cba120 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:58.567746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-648a767b-4b02-4295-9249-007813cba120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:58.651598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 527/1029] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:58.675833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc2f25-91cf-4c1e-88ce-25d74e9964a9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:58.788239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc2f25-91cf-4c1e-88ce-25d74e9964a9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.822269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.823063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.823348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.823649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.824809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.826229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5138-8c6f-4d3a-84b9-776f5413dee9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:58.828082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 503/1030] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:50:58.833898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a767b-4b02-4295-9249-007813cba120 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:58.880569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:58.923493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0da3-0937-4b24-a2ee-66d741213ed2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.923821 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0da3-0937-4b24-a2ee-66d741213ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.924099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c0da3-0937-4b24-a2ee-66d741213ed2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.925596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 504/1031] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:50:58.930341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.930660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.930934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.944828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a767b-4b02-4295-9249-007813cba120 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:58.948284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:50:58.949471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:50:58.961169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:58.983591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:58.984265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:58.984570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:58.984847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:58.985562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:58.986986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:59.024531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 505/1032] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:50:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:50:59.048110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.067090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 528/1033] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:50:58 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:50:59.165255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4933-0c5a-45bb-af36-dbbad66a32af None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:59.203350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:59.204205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:59.204494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:59.204773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:59.217327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:50:59.226623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:59.227714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:59.228621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 506/1034] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:50:59.234093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.344736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69dc57-bc72-4e63-8503-0870c798f81c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:59.346361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:59.381301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:59.381997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:59.382284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:59.382570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:59.383325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:59.383667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:59.385114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:59.393738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 529/1035] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:59.400255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.410387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:59.501487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bc100-6e2d-409d-a1e8-8280958e582d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:59.535626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:59.536409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:59.536689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:59.536959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:59.548250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:59.549690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:50:59.566424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:59.567347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:59.568342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:50:59.568342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:50:59.568342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:50:59.568342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:59.569835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 507/1036] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:59.573921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.679041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63273f-0604-44f9-87f8-1ecdff5ce16a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:59.715332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:59.716032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:59.716322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:59.716601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:59.717327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:50:59.717639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:59.719006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:59.732468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 530/1037] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:50:59.738121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.797592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:50:59.840550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8d06-eb21-42da-85b0-76d6c23e4f8e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:50:59.874954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:50:59.875784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:50:59.876069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:50:59.876343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:50:59.885224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:50:59.886704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:50:59.901901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:50:59.902890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:50:59.903932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 508/1038] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:50:59.911423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:50:59.940017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:00.016064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddf80-caf6-420a-9260-e3ed8045bbfb None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:00.048912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:00.049571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.049856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.050129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.050952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:00.051264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:00.053245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:00.070976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 531/1039] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:00.076355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.178479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd8cf-ad3c-4018-93ea-60bd7d6f8df9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:00.195995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:00.212972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:00.213618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.213900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.214175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.285330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:00.286769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:00.394948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 509/1040] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:00.397152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.481009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:00.499291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd236f-5dff-4fcd-a238-a2feb092fbaa None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:00.537686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:00.538633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.538916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.539191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.550030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:00.551459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:00.569233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:00.570140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:00.571082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:00.571082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:00.571082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:00.571082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:00.571905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 532/1041] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:00.575969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.594782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:00.676291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156544-8e1c-4c36-8d21-016a4d8ffbcc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:00.710737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:00.711400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.711712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.711984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.712690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:00.712989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:00.714350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ac153-34de-44dc-9260-2eb87cf46ef3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:00.725951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 510/1042] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:00.731354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.831167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d11df-9e56-4c2d-9e44-903420c33e00 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:00.850446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8dac5-8a66-4c85-8d14-a4315d3313e7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.851036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8dac5-8a66-4c85-8d14-a4315d3313e7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.851036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8dac5-8a66-4c85-8d14-a4315d3313e7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.852519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 511/1043] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:51:00.857312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.857601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.857879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.866873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:00.867693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:00.868051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:00.868327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:00.870414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:00.874926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:00.876146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:00.876256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:00.877605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:51:00.892402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:00.893534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:00.894497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 533/1044] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:00.900113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.959747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 512/1045] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:51:00.982705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:00.992640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.018829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e85e-2ce0-41f2-b7aa-930642de82d2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.059209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.060039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.060191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.060470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.061270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:01.061583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.063057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.082317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 534/1046] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:01.084147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.090322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ceb8a-d2c8-479c-91bf-b52ae68916a9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.129023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.129808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.130091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.130360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] PATH_INFO: `/v3/services/image` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.131224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.132770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:01.144263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:01.145303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 12:51:01.146168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:01.146972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.147057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 513/1047] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 6 12:51:00 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:01.151514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.202284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4190-b841-46b6-8353-5d751c7c98be None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.229612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.244797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.245521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.245918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.246461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.247409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] RBAC: Adding query filter params (role.id=5b97e79949f543939ea5776757113aaa, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:01.247899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.249465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.256295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 535/1048] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=5b97e79949f543939ea5776757113aaa => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:01.263648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b2cb-2aaa-4227-ba03-dba96c520911 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.302475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.303157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.303464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.303773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.304483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] RBAC: Adding query filter params (name=image) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:01.304788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.306182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635446-74d8-4cb0-9896-c00e34f1ebdf None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.316603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 514/1049] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:01.317751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.413069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb40be-9b53-43fb-a9b8-91591bfd3cd7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.413358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb40be-9b53-43fb-a9b8-91591bfd3cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.413637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb40be-9b53-43fb-a9b8-91591bfd3cd7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.415209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 515/1050] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:51:01.420912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.421210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.421485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.428587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef26b5-3e77-4be2-a47b-e5c200ae1cff None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.438641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:01.439900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:01.448038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.469503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.470170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.470462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.470744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.471456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] RBAC: Adding query filter params (type=image) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:01.471799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.473213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.478643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 536/1051] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:01.484612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.519758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 516/1052] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:51:01.541136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.605554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48597-44ba-4bbf-ab31-479a87330b4a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.613097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.646991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.648199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.648595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.648883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.649646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.651102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.651865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c53415-91f2-4bc8-8a3a-cb4460d42aff None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.686919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.687740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.688027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.688303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.699961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:01.707497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:01.708474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:01.709840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 517/1053] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:01.714655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.769604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 537/1054] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:51:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:51:01.826197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af82c-0847-44be-974e-444f9ad3d76b None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:01.855592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:01.873984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:01.874730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:01.875056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:01.875408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:01.876136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:01.876445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:01.877865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:01.892782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 518/1055] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:01.894609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:01.946938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:02.010808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7668b3d-4260-4f54-9de7-3d3a3830409d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:02.047882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:02.048769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:02.049062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:02.049350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] PATH_INFO: `/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:02.063621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] RBAC: Authorizing `identity:get_user(user_id=6140bb5bebbf4d4cbc6a84d934e141c3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:02.065078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:02.066930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 538/1056] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:01 2022] GET /identity/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:02.073315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:02.178192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49f51-215a-4132-99d1-c8b60c7b8cd8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:02.212933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:02.213586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:02.213871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:02.214146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:02.267933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:02.284169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:02.285628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:02.392222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 519/1057] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:02.393907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:02.493048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:02.498957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb893eca-967e-46a9-b893-416949eab065 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:02.535798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:02.536676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:02.537000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:02.537775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:02.539279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:02.540941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca570-8d53-45c5-a440-64f359ad3d0f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:02.542819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 539/1058] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:02 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:02.548628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:02.637403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:02.654277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0b78d-8055-45aa-b103-06926e8b5543 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:02.689801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:02.690463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:02.690750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:02.691029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:02.691937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=5d615a08d9304d4bb102aef05fa55abe, user.id=6140bb5bebbf4d4cbc6a84d934e141c3) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:02.692254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:02.694435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7a06-0492-451b-a9fa-50fe2df9da72 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:02.700032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 520/1059] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:02 2022] GET /identity/v3/role_assignments?user.id=6140bb5bebbf4d4cbc6a84d934e141c3&scope.project.id=5d615a08d9304d4bb102aef05fa55abe&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:03.527481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874576-b9d8-4e22-9a99-84039406c7d0 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:03.528124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874576-b9d8-4e22-9a99-84039406c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:03.528124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874576-b9d8-4e22-9a99-84039406c7d0 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:03.529461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 540/1060] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:03.534522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:03.534965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:03.535115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:03.553330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:03.554688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:03.624153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 521/1061] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:03.646915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be874576-b9d8-4e22-9a99-84039406c7d0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:03.755244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be874576-b9d8-4e22-9a99-84039406c7d0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:03.790278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:03.791011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:03.791296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:03.791606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:03.801859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:03.810956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:03.812333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:51:03.813297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:03.815940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 541/1062] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:03.819080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:03.897427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:03.925414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcfc3a-d2aa-4efa-b9eb-e9dee5facc03 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:03.961683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:03.962354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:03.962637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:03.962913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:03.963679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:03.963987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:03.965358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73a77-b4b9-4994-af7f-834a9abed008 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:03.978469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 522/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:51:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:03.979465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.006451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.064337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e251-af94-4d31-ae0c-dc13ee272dc9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.064781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e251-af94-4d31-ae0c-dc13ee272dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.065075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e251-af94-4d31-ae0c-dc13ee272dc9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.066437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 523/1064] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:51:04.072115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.072406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.072685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.086274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7127-1ed5-4f69-b1c6-212cf6be2f37 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.090921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:04.092145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:04.120492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.121282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.121566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.121840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.132611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.134042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:04.152212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:04.153157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:04.154095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:04.154095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:04.154095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.154095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:04.154095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 542/1065] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:04.159114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.165463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 524/1066] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:51:04.187246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.237699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.257272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.262135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a921f-7430-424c-8e43-702eb5e5c7a4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.290043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea5500-e4b3-40f8-88e2-0a54afcdae22 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.298630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.299494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.299654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.299916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.300605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:04.300915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.302342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.314702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 543/1067] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:04.320741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.325837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.326487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.326767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.327038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.394213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.395725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.427859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d25b-eb2f-470e-bcd6-627534e70a22 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.463018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.466036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628da75-c346-4095-afab-1d7209401091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.467111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628da75-c346-4095-afab-1d7209401091 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.467663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628da75-c346-4095-afab-1d7209401091 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.468161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628da75-c346-4095-afab-1d7209401091 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.472013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.477547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628da75-c346-4095-afab-1d7209401091 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.480178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628da75-c346-4095-afab-1d7209401091 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-9628da75-c346-4095-afab-1d7209401091 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:51:04.494124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:04.495297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:51:04.496445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:04.497039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 525/1068] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 12:51:04.497126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 544/1069] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:04.502208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.502760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628da75-c346-4095-afab-1d7209401091 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.606036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628da75-c346-4095-afab-1d7209401091 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.606639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d7e7-0b8f-4cad-9a9c-8d355cf65e88 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.643268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.643989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.644275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.644548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.645398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:04.645695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.645823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.647284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.647594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.647767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.647870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.660476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.662290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.667446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 545/1070] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:04.672814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:04.682453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:04.683370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:04.684715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:04.684715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:04.684715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.684715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:04.685403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 526/1071] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:04.689748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.716496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.737516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.783968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bdd24-e659-4f11-bf5c-ca69e9691e02 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.797013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb3-b9a9-4ea7-9122-ad3969f4bc66 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.821691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.822489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.822777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.823053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.832735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:04.833396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.834314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.834533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.834637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.835251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:04.835585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:04.836004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.836996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:04.849795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 527/1072] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-368f3aac-0fbd-494f-a082-35fc16283165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:04.856020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:04.857069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:04.858103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:04.858103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:04.858103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:04.858103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:04.859909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 546/1073] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:04.863214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:04.966127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:04.968914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadfe8f-32cc-4a0f-8dcf-92b83e4d3cb2 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.969200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadfe8f-32cc-4a0f-8dcf-92b83e4d3cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.969478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadfe8f-32cc-4a0f-8dcf-92b83e4d3cb2 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.970854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 547/1074] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:04.976374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:04.983645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:04.983645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:04.985248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b3ce-fb92-46d8-a19d-ca18014f1fa2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:04.994701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:04.995970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:05.026073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.027115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.027756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.027889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.028602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:05.028847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.030656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.044691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 528/1075] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:05.050265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.073341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 548/1076] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:05.096462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.141059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.169338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bb5de-9a78-48ce-b083-de4d6c9c7d9a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.204851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.205646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.205932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.206207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.213470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.214924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.217562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e1f07-f4c6-47cb-90fc-b566e4368a84 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:51:05.229371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:05.230594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:05.231786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 529/1077] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:05.236210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.238807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.255005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.256219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.256523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.256810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.267067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:05.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:05.276929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:05.277792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 549/1078] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:05.283158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.335019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1490-8656-4258-9bd1-c513a392e14e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.367362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.368065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.368346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.368614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.369379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:05.369682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.371088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.376893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.382616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f975c63-6833-4e9a-b373-f819ac354393 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.384664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 530/1079] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:05.388964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.417599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.418197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.418482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.418765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.419507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:05.419851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.421209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.429921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 550/1080] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:05.435642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.450238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.489741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbc110-ba17-4241-8af7-8de32e5d2dd5 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.523329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.524239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.524519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.524797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/5b97e79949f543939ea5776757113aaa` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.527240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=966c3cbce1b443fd9aae9c03cbe6a406, role_id=5b97e79949f543939ea5776757113aaa)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.528696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.533644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa196-ef88-4e14-8fa2-f849af29cdd4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.566836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.567731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.568679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.569041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] PATH_INFO: `/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.570237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] RBAC: Authorizing `identity:get_user(user_id=6140bb5bebbf4d4cbc6a84d934e141c3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.571690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.573309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 551/1081] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:05.578835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.606244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.607833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 531/1082] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:51:05 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/966c3cbce1b443fd9aae9c03cbe6a406/roles/5b97e79949f543939ea5776757113aaa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:51:05.688043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37816e-7083-4ca0-b9af-83c35c4b808e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.725707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.726623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.726910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.727186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.728446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.729916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f3402-0bc5-4e61-b69b-5dbbd248e9f5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.731672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 552/1083] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:05 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:05.737790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:05.850833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b7c64-b045-40da-8bd7-0584e8b7ab8a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:05.873275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:05.884651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:05.885563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:05.885847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:05.886122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe/users/6140bb5bebbf4d4cbc6a84d934e141c3/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:05.888141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d615a08d9304d4bb102aef05fa55abe, user_id=6140bb5bebbf4d4cbc6a84d934e141c3, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:05.889585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c45bc-c885-4608-a699-f1e47af92142 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:05.963059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 532/1084] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:51:05 2022] PUT /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe/users/6140bb5bebbf4d4cbc6a84d934e141c3/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 12:51:07.839958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a9b-becd-4a07-9bc7-27349f6d057d None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:07.840493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a9b-becd-4a07-9bc7-27349f6d057d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:07.840493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a9b-becd-4a07-9bc7-27349f6d057d None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:07.841873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 553/1085] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:07.848190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:07.848621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:07.848740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:07.866458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:07.867676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:07.939745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 533/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:07.964193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d54a9b-becd-4a07-9bc7-27349f6d057d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.056828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.064406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d54a9b-becd-4a07-9bc7-27349f6d057d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.098977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.099797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.100108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.100393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.110341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-af198e56-1276-4107-85bb-799ed264b010 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:08.119361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:08.120662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:08.121579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 554/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 6 12:51:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:08.126886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.218001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aabc8-e50d-48ee-8695-0490ef2b5682 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.218294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aabc8-e50d-48ee-8695-0490ef2b5682 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.218654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aabc8-e50d-48ee-8695-0490ef2b5682 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.220050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 555/1088] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 12:51:08.225038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.225326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.225610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.226539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf9a36-5ded-4d8c-a06e-248f17338eda None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.240311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.243045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:08.244267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:08.261534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.262199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.262488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.262766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.263502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:08.263840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.265259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.274144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 534/1089] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:08.280001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.316518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 556/1090] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 12:51:08.340891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.381496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411411-a845-43ee-bd89-98490b044b42 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.414835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.415710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.415997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.416279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.425079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.427555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.429409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.442336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d15d6-99de-4113-9c18-4ee19e6d4beb None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:08.446860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:08.448013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:08.448934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:08.448934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:08.448934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:08.448934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:08.448934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 535/1091] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:08.453739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.479124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.479952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.480241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.480521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.481816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.491331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:08.498969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:08.500010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:08.501067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 557/1092] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:08.506181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.557404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f00e-bc6e-4593-ba83-18aa1ca8c702 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.592063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.592716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.593001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.593277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.593989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:08.594297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.595680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.606944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 536/1093] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:08.610032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca9dc-a2f3-4f05-a649-22d5ac2a0ae7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.612417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.644219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.644806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.645088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.645363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.646311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:08.646631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.648012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.656159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 558/1094] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:08.662293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.671198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.696897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.712443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93840bd8-08aa-457f-b692-1b18efbd427f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.746463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.747247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.747553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.747899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.754840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.756937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.761644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a5097-37e1-4596-8996-85d0dcd80476 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:51:08.772624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:08.773622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:08.774619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 537/1095] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:08.779656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.796978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.797854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.798149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.798425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] PATH_INFO: `/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.799645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] RBAC: Authorizing `identity:get_user(user_id=6140bb5bebbf4d4cbc6a84d934e141c3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.801114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.802868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 559/1096] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/users/6140bb5bebbf4d4cbc6a84d934e141c3 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:08.808474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.877852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b89a4-4441-4068-a504-0cdedfe8ff1e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.883206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:08.913111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36185baf-fcf2-46a0-bd4e-bf20bc938e92 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:08.919409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.920115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.920398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.920674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.921503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:08.921811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:08.923246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:08.940585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 538/1097] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:08.946984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:08.948485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:08.949163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:08.949453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:08.949735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:08.950327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.017331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.018804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.045001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f12bb-a7ca-40c6-adac-c08a7939e045 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.078335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.078981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.079263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.079555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.090215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.115280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 560/1098] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 12:51:09.121320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.147238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.148733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.151619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.220253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b212-567f-4d05-9bae-fbf85bb8b51c None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.247216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 539/1099] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 12:51:09.253007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.253763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.254622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.254944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.255256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.256465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.257895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.259593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 561/1100] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:09.265292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.307761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.354489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b6a5f-3156-4a25-954f-50491ea7ac37 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.357466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.364184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb726-6732-4c8d-bb02-87ab734de461 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.388674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.389507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.389992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.390436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.399648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.400384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.400601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.401518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.401954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=5d615a08d9304d4bb102aef05fa55abe, user.id=6140bb5bebbf4d4cbc6a84d934e141c3) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:09.402268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.402958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.403699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.409482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 562/1101] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/role_assignments?user.id=6140bb5bebbf4d4cbc6a84d934e141c3&scope.project.id=5d615a08d9304d4bb102aef05fa55abe&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:09.421170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:09.422356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:09.423369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:51:09.423369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:09.423369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:51:09.423369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:09.423369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 540/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:09.429182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.534327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebcd2-a0e5-4df3-b966-c2b605e88fe9 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.542639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:09.571674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.572347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.572630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.572901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.573632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:09.573935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.575311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.588384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 563/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:09.594354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.698503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e53d7-ce1f-4809-b998-9748674f399a None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.731453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.732269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.732551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.732826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.739896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.741432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:51:09.754750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:09.756521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:09.757502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 541/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:09.762455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.860533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3275-ed6d-419e-a4da-39e0206067a5 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:09.893050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:09.893703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:09.893983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:09.894257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:09.895029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:09.895336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:09.896818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c663d-5fba-448c-b22d-1f2e9700de77 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:09.910016 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 564/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:09.916114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:09.934935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:10.024152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a115ac6-4a5d-4f1c-891c-00959cc5d520 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:10.057818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:10.058466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:10.058750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:10.059025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:10.059877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] RBAC: Adding query filter params (role.id=5b97e79949f543939ea5776757113aaa, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=966c3cbce1b443fd9aae9c03cbe6a406) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:10.060190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:10.061622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae082-b50b-4fc5-8544-9c22d6b73f68 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:10.067441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 542/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:09 2022] GET /identity/v3/role_assignments?user.id=966c3cbce1b443fd9aae9c03cbe6a406&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=5b97e79949f543939ea5776757113aaa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:11.681080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147166-94d1-45f2-8e4d-dfd6d244c153 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:11.681608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147166-94d1-45f2-8e4d-dfd6d244c153 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:11.681720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147166-94d1-45f2-8e4d-dfd6d244c153 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:11.683015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 565/1107] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:11.688353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:11.688761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:11.688910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:11.705629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:11.706805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:11.770944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 543/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:11.795839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147166-94d1-45f2-8e4d-dfd6d244c153 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:11.823615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:11.897270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147166-94d1-45f2-8e4d-dfd6d244c153 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:11.930425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:11.931267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:11.931505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:11.931816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:11.932968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:11.934397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f38a6-9c7f-431b-8ffe-673b2d79ffd9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:11.936049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 566/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:11.941738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:11.953945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:12.040580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa67f-b23f-4a27-bf24-54a7eed1ba91 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:12.081990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:12.082657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:12.083132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:12.083675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:12.084453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:12.085837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26852-747b-4afc-bc72-c7f1c55629a5 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:12.196628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 544/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:51:11 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:51:14.469076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14167ea-f441-4e03-9e9a-6d976254dc38 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:14.469604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14167ea-f441-4e03-9e9a-6d976254dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:14.469604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14167ea-f441-4e03-9e9a-6d976254dc38 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:14.470997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 567/1111] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:14.476896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:14.477310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:14.477459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:14.494043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:14.495230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:14.554511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:14.561685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 545/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:14.586656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14167ea-f441-4e03-9e9a-6d976254dc38 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:14.679107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:14.686410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14167ea-f441-4e03-9e9a-6d976254dc38 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:14.720381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:14.721170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:14.721457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:14.721736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] PATH_INFO: `/v3/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:14.723280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] RBAC: Authorizing `identity:get_role(role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:14.724799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:14.726165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 568/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:14 2022] GET /identity/v3/roles/69292b9b6bc94583adb5935816723fd8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:14.731907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:14.826640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a17fc-b9f8-4c95-b400-1f5ee45c9306 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:14.859468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:14.860355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:14.860637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:14.860912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] PATH_INFO: `/v3/users/138cb5d149ac43c8ba5feeed26104830` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:14.873386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] RBAC: Authorizing `identity:get_user(user_id=138cb5d149ac43c8ba5feeed26104830)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:14.874822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:14.876462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 546/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:14 2022] GET /identity/v3/users/138cb5d149ac43c8ba5feeed26104830 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:14.882649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:14.981579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b1daf-2066-4a13-ae28-d648cf3e079d None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:15.015237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:15.015932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:15.016224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:15.016506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:15.045296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:15.083205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:15.084705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:15.180176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 569/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:15.186073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:15.241944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:15.285036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafd1c0-923e-46ab-ad30-4541af9f8bbc None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:15.318082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:15.318916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:15.319196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:15.319468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:15.320647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:15.322066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943927a2-ebee-46b9-acdb-cdb74d1ddffa None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:15.323736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 547/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:15 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:15.329929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:15.389389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:15.427284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eabbc-f22f-462a-a49d-4fd21d8f7974 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:15.460868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:15.461512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:15.461793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:15.462067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:15.462884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5d615a08d9304d4bb102aef05fa55abe, user.id=138cb5d149ac43c8ba5feeed26104830) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:15.463195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:15.464649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3dafb-df0e-4e20-9e45-f373a38aa9c7 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:15.470080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 570/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:15 2022] GET /identity/v3/role_assignments?user.id=138cb5d149ac43c8ba5feeed26104830&scope.project.id=5d615a08d9304d4bb102aef05fa55abe&role.id=69292b9b6bc94583adb5935816723fd8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:17.657395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192284d-d8fa-4758-8977-57835f71d5ed None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:17.657922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192284d-d8fa-4758-8977-57835f71d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:17.657922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192284d-d8fa-4758-8977-57835f71d5ed None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:17.659278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 548/1118] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:17.664486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:17.664894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:17.665048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:17.681478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:17.682654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:17.747783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 571/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:17.772192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192284d-d8fa-4758-8977-57835f71d5ed None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:17.870893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192284d-d8fa-4758-8977-57835f71d5ed None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:17.892793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:17.904720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:17.905570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:17.915594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:17.915594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] PATH_INFO: `/v3/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:17.915594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] RBAC: Authorizing `identity:get_role(role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:17.915594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:17.915594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 549/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:17 2022] GET /identity/v3/roles/69292b9b6bc94583adb5935816723fd8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:17.916682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:17.972402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:18.015209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef443d-760c-42a0-9dfd-a732e922310c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:18.047069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:18.047955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:18.048243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:18.048521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] PATH_INFO: `/v3/users/138cb5d149ac43c8ba5feeed26104830` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:18.049683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] RBAC: Authorizing `identity:get_user(user_id=138cb5d149ac43c8ba5feeed26104830)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:18.051760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:18.053426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 572/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:17 2022] GET /identity/v3/users/138cb5d149ac43c8ba5feeed26104830 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:18.059225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:18.155871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4995-1f7c-4aa5-8282-1ac7dd726374 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:18.188549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:18.189321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:18.189600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:18.189871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:18.191028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:18.193104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241adc4d-b2bc-41d1-8d4b-429c0572d6d9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:18.194754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 550/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:18 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:18.200674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:18.296757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099b02-18de-477d-b90f-f8c388dedcf3 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:18.319911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:18.329959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:18.330828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:18.331105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:18.331446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe/users/138cb5d149ac43c8ba5feeed26104830/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:18.333560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d615a08d9304d4bb102aef05fa55abe, user_id=138cb5d149ac43c8ba5feeed26104830, role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:18.334978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d205fa4-6fb9-44a0-a989-127d035c8979 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:18.407048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 573/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:51:18 2022] PUT /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe/users/138cb5d149ac43c8ba5feeed26104830/roles/69292b9b6bc94583adb5935816723fd8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:51:20.628759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48458-24f5-414a-9c98-64515b6de2d3 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:20.630045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48458-24f5-414a-9c98-64515b6de2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:20.630045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48458-24f5-414a-9c98-64515b6de2d3 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:20.631164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 551/1124] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:20.636471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:20.636878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:20.637031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:20.654273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:20.655439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:20.719188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 574/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:20.743011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48458-24f5-414a-9c98-64515b6de2d3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:20.800326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:20.840663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48458-24f5-414a-9c98-64515b6de2d3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:20.873117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:20.873950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:20.874230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:20.874499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] PATH_INFO: `/v3/roles/69292b9b6bc94583adb5935816723fd8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:20.875966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] RBAC: Authorizing `identity:get_role(role_id=69292b9b6bc94583adb5935816723fd8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:20.877328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:20.878652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 552/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:20 2022] GET /identity/v3/roles/69292b9b6bc94583adb5935816723fd8 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:20.884560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:20.981110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0f074-ceaa-4eb5-a260-4358be295302 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:20.994483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:21.013462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:21.014324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:21.014610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:21.014887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] PATH_INFO: `/v3/users/138cb5d149ac43c8ba5feeed26104830` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:21.016117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] RBAC: Authorizing `identity:get_user(user_id=138cb5d149ac43c8ba5feeed26104830)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:21.017534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:21.019133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 575/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:20 2022] GET /identity/v3/users/138cb5d149ac43c8ba5feeed26104830 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:21.025502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:21.122362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64405-dae5-4ad8-893e-a5d762aa057f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:21.146839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:21.155248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:21.157487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:21.157487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:21.157487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:21.221425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:21.224025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:21.318443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 553/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:21.324364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:21.420860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc769a-c79e-477a-985b-7f37784535b2 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:21.452952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:21.453794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:21.454077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:21.454350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] PATH_INFO: `/v3/projects/5d615a08d9304d4bb102aef05fa55abe` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:21.455497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] RBAC: Authorizing `identity:get_project(project_id=5d615a08d9304d4bb102aef05fa55abe)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:21.457511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66bc1a-b1a7-4eb3-9e54-772ddb06a8ac None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:21.459353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 576/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:21 2022] GET /identity/v3/projects/5d615a08d9304d4bb102aef05fa55abe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:21.465502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:21.491844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:21.567362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8b07-20bd-4e47-8c4e-a702260fadbe None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:21.600667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:21.601312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:21.601599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:21.601877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:21.602690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] RBAC: Adding query filter params (role.id=69292b9b6bc94583adb5935816723fd8, scope.project.id=5d615a08d9304d4bb102aef05fa55abe, user.id=138cb5d149ac43c8ba5feeed26104830) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:21.603003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:21.604456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d0aab-25ec-499d-822e-d02bc21a04ae None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:21.610108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 554/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:21 2022] GET /identity/v3/role_assignments?user.id=138cb5d149ac43c8ba5feeed26104830&scope.project.id=5d615a08d9304d4bb102aef05fa55abe&role.id=69292b9b6bc94583adb5935816723fd8 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:23.890341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1018-cadb-4211-a251-4c2da3ca58e9 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:23.890876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1018-cadb-4211-a251-4c2da3ca58e9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:23.890991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1018-cadb-4211-a251-4c2da3ca58e9 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:23.892398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 577/1131] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:23.898700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:23.899081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:23.899260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:23.916758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:23.917954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:23.981827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 555/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:24.006311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b1018-cadb-4211-a251-4c2da3ca58e9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:24.056474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:24.106069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b1018-cadb-4211-a251-4c2da3ca58e9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:24.138965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:24.139831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:24.140112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:24.140430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:24.141526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:24.142933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475c99-f5fb-435a-a785-1fd7237f3c5d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:24.144736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 578/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:24.150774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:24.170948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:24.245785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb3b05-f1a6-4c98-ac55-27d330d2fbb6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:24.278559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:24.279193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:24.279478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:24.279774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:24.280472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:24.281878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134a32-bc3b-4715-a979-f0f2c60bf5b8 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:24.360626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 556/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:51:24 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:51:26.733636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd19f-f8fb-4f42-8eb4-836463e7a50a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:26.734179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd19f-f8fb-4f42-8eb4-836463e7a50a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:26.734179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd19f-f8fb-4f42-8eb4-836463e7a50a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:26.735579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 579/1135] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:26.741132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:26.741507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:26.741699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:26.758565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:26.759780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:26.824539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 557/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:26.849632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd19f-f8fb-4f42-8eb4-836463e7a50a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:26.950864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd19f-f8fb-4f42-8eb4-836463e7a50a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:26.968059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:26.990672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:26.990672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:26.990672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:26.990672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:26.991087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:26.991087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83099729-2cc8-4f3e-be7c-dfa781fd792a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:26.991087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 580/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:26.996001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:26.998160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:27.092967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341616-30f4-4cde-9cc4-601d9d380ca4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:27.125872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:27.126529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:27.126814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:27.127091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:27.127815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:27.129654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7df115-01fc-4f03-a3b8-e0f4df43eb9a None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:27.205620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 558/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:51:26 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:51:29.475150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e01b-9737-4132-b954-6d7ca1db76bb None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:29.475752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e01b-9737-4132-b954-6d7ca1db76bb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:29.475752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e01b-9737-4132-b954-6d7ca1db76bb None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:29.477110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 581/1139] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:29.482389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:29.482766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:29.482949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:29.499634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:29.500795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:29.552005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:29.564776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 559/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:29.588813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e01b-9737-4132-b954-6d7ca1db76bb None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:29.688102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e01b-9737-4132-b954-6d7ca1db76bb None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:29.720433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:29.721214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:29.721500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:29.722392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:29.732245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:29.739902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:29.741070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:29.742117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 582/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:29.746982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:29.849122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131c6b-dbc2-4026-af32-ce7cf8397e47 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:29.881781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:29.882434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:29.882719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:29.882993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:29.883754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:29.884059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:29.885420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:29.893330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 560/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:29.900092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:29.946311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:29.998761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831c23-3770-4530-a860-dd1b8e9ceeb7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:30.031478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:30.032369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:30.032657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:30.032936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] PATH_INFO: `/v3/users/56f4b5e615f94111af110909d4b33f12` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:30.045623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] RBAC: Authorizing `identity:get_user(user_id=56f4b5e615f94111af110909d4b33f12)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:30.047064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:30.048719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 583/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:29 2022] GET /identity/v3/users/56f4b5e615f94111af110909d4b33f12 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:30.055135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:30.103973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:30.153593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edb97-968f-4d28-9f82-5e88df1e3319 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:30.186209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:30.186840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:30.187129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:30.187401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:30.251715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:30.253707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:30.298694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:30.348016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 561/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:30.353845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:30.451145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fa625-472a-4e81-96ec-b5c124a7db53 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:30.453433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:30.483750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:30.484590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:30.484874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:30.485170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] PATH_INFO: `/v3/projects/d44150e994884f26a0bfd6b592aee6e2` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:30.486502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] RBAC: Authorizing `identity:get_project(project_id=d44150e994884f26a0bfd6b592aee6e2)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:30.489070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c76356-ae7a-49ec-91ad-ec99a612f43d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:30.490739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 584/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:30 2022] GET /identity/v3/projects/d44150e994884f26a0bfd6b592aee6e2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:30.496948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:30.591347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d433ff-eee0-4094-ae56-c01555140e3e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:30.624383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:30.625017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:30.625298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:30.625571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:30.626376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=d44150e994884f26a0bfd6b592aee6e2, user.id=56f4b5e615f94111af110909d4b33f12) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:30.626683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:30.628278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d695-a32c-4b6e-921a-d0570c0ac204 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:30.633479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 562/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:30 2022] GET /identity/v3/role_assignments?user.id=56f4b5e615f94111af110909d4b33f12&scope.project.id=d44150e994884f26a0bfd6b592aee6e2&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:32.848534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4a3a-1a2d-4486-aebf-cf8650e330f7 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:32.849065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4a3a-1a2d-4486-aebf-cf8650e330f7 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:32.849158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4a3a-1a2d-4486-aebf-cf8650e330f7 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:32.850455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 585/1147] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:32.855657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a904-7980-490f-adee-e9999a733df9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:32.856070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a904-7980-490f-adee-e9999a733df9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:32.856222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a904-7980-490f-adee-e9999a733df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:32.873514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2168a904-7980-490f-adee-e9999a733df9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:32.874832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2168a904-7980-490f-adee-e9999a733df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:32.884726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:32.942963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 563/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:32.966624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4a3a-1a2d-4486-aebf-cf8650e330f7 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:33.064384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4a3a-1a2d-4486-aebf-cf8650e330f7 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:33.096614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:33.097517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:33.097798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:33.098072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:33.108101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:33.116311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:33.117255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:33.118135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 586/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:33.123433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a904-7980-490f-adee-e9999a733df9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:33.219341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a904-7980-490f-adee-e9999a733df9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:33.252384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:33.253772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:33.254059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:33.254330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:33.255060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:33.255367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:33.256746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:33.264553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 564/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:33.270927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:33.303233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:33.372738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e881-933f-4be7-91bb-75d4a3ea62b7 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:33.406084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b105161-597e-4811-80b8-689b41265536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:33.406938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b105161-597e-4811-80b8-689b41265536 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:33.407226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b105161-597e-4811-80b8-689b41265536 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:33.407506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b105161-597e-4811-80b8-689b41265536 None admin] PATH_INFO: `/v3/users/56f4b5e615f94111af110909d4b33f12` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:33.408704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b105161-597e-4811-80b8-689b41265536 None admin] RBAC: Authorizing `identity:get_user(user_id=56f4b5e615f94111af110909d4b33f12)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:33.411175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b105161-597e-4811-80b8-689b41265536 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:33.412818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 587/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:33 2022] GET /identity/v3/users/56f4b5e615f94111af110909d4b33f12 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:33.418465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:33.428197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:33.515719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92cfb6-aa1a-4fb0-a1cb-780c2231724f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:33.548355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:33.549199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:33.550118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:33.550402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] PATH_INFO: `/v3/projects/d44150e994884f26a0bfd6b592aee6e2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:33.551684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] RBAC: Authorizing `identity:get_project(project_id=d44150e994884f26a0bfd6b592aee6e2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:33.553109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc215e8c-f593-4746-b481-10101d9def96 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:33.554757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 565/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:33 2022] GET /identity/v3/projects/d44150e994884f26a0bfd6b592aee6e2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:33.560575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b105161-597e-4811-80b8-689b41265536 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:33.655726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:33.658578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b105161-597e-4811-80b8-689b41265536 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:33.693562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:33.694491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:33.694784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:33.695077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] PATH_INFO: `/v3/projects/d44150e994884f26a0bfd6b592aee6e2/users/56f4b5e615f94111af110909d4b33f12/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:33.697316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] RBAC: Authorizing `identity:create_grant(project_id=d44150e994884f26a0bfd6b592aee6e2, user_id=56f4b5e615f94111af110909d4b33f12, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:33.699164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53307b-b7c6-48b2-8bc4-a48279c5d374 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:33.812207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 588/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:51:33 2022] PUT /identity/v3/projects/d44150e994884f26a0bfd6b592aee6e2/users/56f4b5e615f94111af110909d4b33f12/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:51:36.024173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61969a9-7889-4a0c-be23-2c7d4964bc44 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.024709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61969a9-7889-4a0c-be23-2c7d4964bc44 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.024709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61969a9-7889-4a0c-be23-2c7d4964bc44 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.026387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 566/1154] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:36.031638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.032061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.032199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.049119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:36.050351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:36.114789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 589/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:36.138329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61969a9-7889-4a0c-be23-2c7d4964bc44 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:36.213515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:36.238407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61969a9-7889-4a0c-be23-2c7d4964bc44 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:36.272966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:36.273773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.274058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.274333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.285275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:36.292944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:36.293956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:36.295074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 567/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:36.300238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:36.388432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:36.398065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fece259-69e9-4b9d-a7b6-c1799f03715a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:36.431592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:36.432253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.432540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.432819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.433661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:36.433970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:36.435331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:36.443882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 590/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:36.449805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:36.548634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796fd0e-6362-43b9-98a6-72710c0d7323 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:36.581300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:36.582151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.582432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.582704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] PATH_INFO: `/v3/users/56f4b5e615f94111af110909d4b33f12` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.583891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] RBAC: Authorizing `identity:get_user(user_id=56f4b5e615f94111af110909d4b33f12)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:36.585315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:36.586900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 568/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:36 2022] GET /identity/v3/users/56f4b5e615f94111af110909d4b33f12 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:51:36.592641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:36.688548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680ca68-9290-48f9-af6b-5828e927a715 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:36.722509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:36.723146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:36.723434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:36.723740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:36.744350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:36.790473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:36.791958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:36.886753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 591/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:36.892603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:36.896479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:36.992491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706093-b873-4b19-aab7-aa9d050c9a03 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:37.025111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:37.025983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:37.026264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:37.026537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] PATH_INFO: `/v3/projects/d44150e994884f26a0bfd6b592aee6e2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:37.027722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] RBAC: Authorizing `identity:get_project(project_id=d44150e994884f26a0bfd6b592aee6e2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:37.029137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf4c2-b1ce-447d-ae0f-d3bc5044cf21 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:37.030780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 569/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:36 2022] GET /identity/v3/projects/d44150e994884f26a0bfd6b592aee6e2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:37.037479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:37.088054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:37.133908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76bf50-ea17-4fed-bf70-029b8a3e689b None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:37.166606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:37.167212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:37.167496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:37.167808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:37.168628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=d44150e994884f26a0bfd6b592aee6e2, user.id=56f4b5e615f94111af110909d4b33f12) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:37.168938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:37.170348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3ef2-a420-463c-be92-b6ed7b249801 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:37.176146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 592/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:37 2022] GET /identity/v3/role_assignments?user.id=56f4b5e615f94111af110909d4b33f12&scope.project.id=d44150e994884f26a0bfd6b592aee6e2&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:39.391408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf2eb-c676-44b8-8a6d-c5a3b715c2ea None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:39.391951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf2eb-c676-44b8-8a6d-c5a3b715c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:39.392066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf2eb-c676-44b8-8a6d-c5a3b715c2ea None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:39.394306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 570/1162] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:39.399429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:39.400141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:39.400287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:39.416949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:39.418128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:39.482658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 593/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:39.505395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bf2eb-c676-44b8-8a6d-c5a3b715c2ea None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:39.573121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:39.603069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bf2eb-c676-44b8-8a6d-c5a3b715c2ea None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:39.635286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:39.635944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:39.636228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:39.636509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:39.700689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:39.702058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:39.765772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:39.796013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 571/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:39.802509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:39.847734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:39.898529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed3a0-647d-4a07-a32a-80f0732b6090 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:39.932581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:39.933371 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:39.933653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:39.933927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:39.940457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:39.941879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5ad0186b-906c-4784-8995-2d11dcac29cf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:39.956098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:39.957338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:39.958228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 594/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:51:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:39.962986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:40.060544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f8e6-3b1a-4453-9177-0cde1fd514eb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:40.093404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:40.094055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:40.094337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:40.094609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:40.095311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:40.095671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:40.097025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c305792-d345-4d46-9211-189d5b543364 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:40.103913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 572/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 6 12:51:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:42.348396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238bf1-3339-4d4b-926d-19c321cb225f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:42.348908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238bf1-3339-4d4b-926d-19c321cb225f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:42.348908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238bf1-3339-4d4b-926d-19c321cb225f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:42.350237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 595/1167] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:42.355659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9696d-7434-4f8c-9f4b-9455f278f7ae None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:42.356062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9696d-7434-4f8c-9f4b-9455f278f7ae None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:42.356219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9696d-7434-4f8c-9f4b-9455f278f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:42.373066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-29f9696d-7434-4f8c-9f4b-9455f278f7ae None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:42.374244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-29f9696d-7434-4f8c-9f4b-9455f278f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:42.400129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:42.439383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 573/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:42.461609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238bf1-3339-4d4b-926d-19c321cb225f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:42.687438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238bf1-3339-4d4b-926d-19c321cb225f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:42.695302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:42.721477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:42.722164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:42.722441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:42.722713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:42.723452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:42.724869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fd90b-caf1-4ae9-92ce-47e57a53f3a0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:42.783296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 596/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Mon Jun 6 12:51:42 2022] POST /identity/v3/domains => generated 267 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:51:45.035321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc6c4-5d93-4151-8c3a-8eb345ac3b03 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:45.035866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc6c4-5d93-4151-8c3a-8eb345ac3b03 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:45.035955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc6c4-5d93-4151-8c3a-8eb345ac3b03 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:45.037252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 574/1170] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:45.042510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b05-5ce3-4600-8465-90385331656f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:45.042956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b05-5ce3-4600-8465-90385331656f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:45.043057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b05-5ce3-4600-8465-90385331656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:45.059992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-05d18b05-5ce3-4600-8465-90385331656f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:45.061165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-05d18b05-5ce3-4600-8465-90385331656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:45.125095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 597/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:45.147993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc6c4-5d93-4151-8c3a-8eb345ac3b03 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:45.245602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc6c4-5d93-4151-8c3a-8eb345ac3b03 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:45.278619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:45.279451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:45.279756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:45.280028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] PATH_INFO: `/v3/domains/495e511d73f94ac1b490ffe555a212a4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:45.290090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=495e511d73f94ac1b490ffe555a212a4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:45.291553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36108cd-8a2c-43e6-bdf6-858b7e74a454 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:45.293127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 575/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Jun 6 12:51:45 2022] GET /identity/v3/domains/495e511d73f94ac1b490ffe555a212a4 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:45.299617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18b05-5ce3-4600-8465-90385331656f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:45.392237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:45.397961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18b05-5ce3-4600-8465-90385331656f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:45.432935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:45.433583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:45.433873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:45.434152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:45.434869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:45.436427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ba64d-85bb-4cc2-bd74-c3f8e19a72d9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:45.492444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 598/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:51:45 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 12:51:47.718752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b856bf-fbdb-44c9-ae53-23d7972c38eb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:47.719277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b856bf-fbdb-44c9-ae53-23d7972c38eb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:47.719393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b856bf-fbdb-44c9-ae53-23d7972c38eb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:47.721549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 576/1174] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:47.726944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:47.727347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:47.727516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:47.744574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:47.745753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:47.810282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 599/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:47.835311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b856bf-fbdb-44c9-ae53-23d7972c38eb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:47.861215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:47.936179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b856bf-fbdb-44c9-ae53-23d7972c38eb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:47.971437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:47.972249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:47.972528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:47.972800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] PATH_INFO: `/v3/domains/495e511d73f94ac1b490ffe555a212a4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:47.973941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=495e511d73f94ac1b490ffe555a212a4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:47.975363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40fe80-4ed8-4bb0-881b-0551680a79a9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:47.976973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 577/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Jun 6 12:51:47 2022] GET /identity/v3/domains/495e511d73f94ac1b490ffe555a212a4 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:47.982960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:48.057581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:48.078142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53a64c-2672-4464-82ba-06c211f07857 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:48.111234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:48.112285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:48.112578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:48.112860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:48.113610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:48.115036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286dd07-f911-4291-971e-cae521cf90a1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:48.199046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 600/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:51:47 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:51:50.464790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04edbf-8041-47cc-a65c-bbafac1120be None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:50.465351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04edbf-8041-47cc-a65c-bbafac1120be None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:50.465351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04edbf-8041-47cc-a65c-bbafac1120be None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:50.466679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 578/1178] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:50.472818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:50.473218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:50.473366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:50.490461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:50.491671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:50.556212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 601/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:50.581547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04edbf-8041-47cc-a65c-bbafac1120be None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:50.672985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:50.682553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04edbf-8041-47cc-a65c-bbafac1120be None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:50.716602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:50.717326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:50.717609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:50.717885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:50.728134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:50.736373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:50.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:50.738808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 579/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:50.743462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:50.803388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:50.840166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378a454-f9ec-486a-b4f6-a980a877f861 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:50.874684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:50.875343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:50.875661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:50.876430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:50.877182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:50.877494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:50.878851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:50.886722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 602/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:50.892888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:50.994458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff922e4-0029-4939-b388-dcf8e6d804c1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:51.028537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:51.029394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:51.029680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:51.029956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] PATH_INFO: `/v3/users/4f0092b39b434381b277ad4ccc809962` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:51.043788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] RBAC: Authorizing `identity:get_user(user_id=4f0092b39b434381b277ad4ccc809962)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:51.045228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:51.046847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 580/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:50 2022] GET /identity/v3/users/4f0092b39b434381b277ad4ccc809962 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:51.052709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:51.148998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3395-8851-43de-908a-ef4957b5c34a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:51.174073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:51.182427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:51.183089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:51.183376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:51.183689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:51.249669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:51.251157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:51.347790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 603/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:51.353616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:51.366133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:51.455122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184fe0-dcb9-406b-b066-a93720c43e62 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:51.488678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:51.489519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:51.489802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:51.490076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] PATH_INFO: `/v3/projects/afe8267304434bfea844648a60633dc6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:51.491255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] RBAC: Authorizing `identity:get_project(project_id=afe8267304434bfea844648a60633dc6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:51.492711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bede4-0e76-4ac4-86f0-3213b971afad None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:51.494372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 581/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:51 2022] GET /identity/v3/projects/afe8267304434bfea844648a60633dc6 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:51.500601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:51.527959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:51.597870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad9001-ac55-4206-8ad5-8386bc720c19 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:51.631366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:51.632044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:51.632327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:51.632602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:51.633423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=afe8267304434bfea844648a60633dc6, user.id=4f0092b39b434381b277ad4ccc809962) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:51.633734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:51.635145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca453e9b-e46b-4aa9-b901-037206569099 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:51.640485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 604/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:51 2022] GET /identity/v3/role_assignments?user.id=4f0092b39b434381b277ad4ccc809962&scope.project.id=afe8267304434bfea844648a60633dc6&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:53.824709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b7-502e-43c6-a43b-12f35207b812 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:53.825269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b7-502e-43c6-a43b-12f35207b812 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:53.825269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a25b7-502e-43c6-a43b-12f35207b812 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:53.826602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 582/1186] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:53.832474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:53.832903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:53.833048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:53.850100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:53.851276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:53.916961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 605/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:53.939781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a25b7-502e-43c6-a43b-12f35207b812 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:54.015397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:54.038048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a25b7-502e-43c6-a43b-12f35207b812 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:54.072837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:54.073615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:54.073896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:54.074170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:54.083898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:54.091311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:54.092472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:51:54.093539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 583/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 12:51:54.098518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:54.119586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:54.196169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a999138-a9f3-4d85-8bac-b43633492716 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:54.227892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:54.228547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:54.228827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:54.229096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:54.229823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:54.230123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:54.231458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:54.239905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 606/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:54.245658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:54.342124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c459e-2f1e-4b4e-bc4d-c565ba8428c8 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:54.373977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:54.374820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:54.375101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:54.375369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] PATH_INFO: `/v3/users/4f0092b39b434381b277ad4ccc809962` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:54.377120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] RBAC: Authorizing `identity:get_user(user_id=4f0092b39b434381b277ad4ccc809962)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:54.378528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:54.380142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 584/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:54 2022] GET /identity/v3/users/4f0092b39b434381b277ad4ccc809962 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:54.385747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:54.465157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:54.481889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364fa4-152f-4f29-a46b-9e9e2eda2438 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:54.513957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:54.514795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:54.515073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:54.515341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] PATH_INFO: `/v3/projects/afe8267304434bfea844648a60633dc6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:54.517101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] RBAC: Authorizing `identity:get_project(project_id=afe8267304434bfea844648a60633dc6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:54.518506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe672ec-946c-4be1-8456-ef608dc9649b None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:54.520176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 607/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:54 2022] GET /identity/v3/projects/afe8267304434bfea844648a60633dc6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:54.526101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:54.535197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:54.620920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fef9-0061-47f4-97c2-1ac8d3c3dfce None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:54.653497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:54.654364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:54.654646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:54.654918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] PATH_INFO: `/v3/projects/afe8267304434bfea844648a60633dc6/users/4f0092b39b434381b277ad4ccc809962/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:54.656893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] RBAC: Authorizing `identity:create_grant(project_id=afe8267304434bfea844648a60633dc6, user_id=4f0092b39b434381b277ad4ccc809962, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:54.658445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1720ba-53f0-44c3-b718-c88436fddacb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:54.729787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 585/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:51:54 2022] PUT /identity/v3/projects/afe8267304434bfea844648a60633dc6/users/4f0092b39b434381b277ad4ccc809962/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:51:56.908240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83bcf5-7250-4914-bf02-2bda6088c2b3 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:56.908650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83bcf5-7250-4914-bf02-2bda6088c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:56.908792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83bcf5-7250-4914-bf02-2bda6088c2b3 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:56.910147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 608/1193] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:51:56.915322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:56.915778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:56.915907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:56.932684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:51:56.933864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:51:56.990473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:56.997564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 586/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:51:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:51:57.021572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83bcf5-7250-4914-bf02-2bda6088c2b3 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:57.123424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83bcf5-7250-4914-bf02-2bda6088c2b3 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:57.158446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:57.159170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:57.159450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:57.159750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:57.169641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:51:57.177228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:51:57.178335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:51:57.179411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 609/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:51:57.184410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:57.279109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f753a-f2ad-4920-8927-cc25dfe76cee None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:57.311968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:57.313100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:57.313605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:57.313890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:57.314627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:57.314937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:57.316319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:57.324111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 587/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:57.330363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:57.342682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:57.426509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50c2ff-85f4-4cce-b2e7-f831b444858f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:57.458514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:57.459358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:57.459664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:57.460028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] PATH_INFO: `/v3/users/4f0092b39b434381b277ad4ccc809962` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:57.461185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4f0092b39b434381b277ad4ccc809962)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:57.462595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:57.464204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 610/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/users/4f0092b39b434381b277ad4ccc809962 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:57.470447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:57.526564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:57.567700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34b43-198d-4958-8dd5-a4825d6eb253 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:57.599716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:57.600347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:57.600628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:57.600901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:57.665802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:57.667233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:57.722300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:57.763215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 588/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:51:57.769035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:57.844839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:51:57.865600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771202f-127d-4117-ab48-f0c839c8c7f0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:57.898468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:57.899588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:57.899869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:57.900140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] PATH_INFO: `/v3/projects/afe8267304434bfea844648a60633dc6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:57.901285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] RBAC: Authorizing `identity:get_project(project_id=afe8267304434bfea844648a60633dc6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:57.902711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238a39-f137-4c9a-adc8-c12b38bc2494 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:57.904411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 611/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/projects/afe8267304434bfea844648a60633dc6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:51:57.910471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:51:58.005771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37312-22d6-440f-a826-f9760213b313 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:51:58.037977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:51:58.038616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:51:58.038897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:51:58.039171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:51:58.040010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=afe8267304434bfea844648a60633dc6, user.id=4f0092b39b434381b277ad4ccc809962) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:51:58.040322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:51:58.041733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3656-458f-4dab-ba34-d7f796d350f4 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:51:58.047888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 589/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:51:57 2022] GET /identity/v3/role_assignments?user.id=4f0092b39b434381b277ad4ccc809962&scope.project.id=afe8267304434bfea844648a60633dc6&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:52:07.894507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=27 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:52:08.044798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:14.678244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ec69f-2815-49d9-ba98-5ceaf2a80341 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:14.678865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ec69f-2815-49d9-ba98-5ceaf2a80341 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:14.678865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ec69f-2815-49d9-ba98-5ceaf2a80341 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:14.680207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 612/1201] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:14.685911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:14.693813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:14.693813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:14.703337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:14.704554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:14.771286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 590/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:14.796746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ec69f-2815-49d9-ba98-5ceaf2a80341 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:14.898213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ec69f-2815-49d9-ba98-5ceaf2a80341 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:14.931876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:14.932595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:14.932876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:14.933151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:14.942988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:14.944440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:14.962213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:14.963388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:14.964473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:14.964473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:14.964473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:14.964473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:14.964473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 613/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:14.970205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:15.066640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da724f68-3c72-416f-89da-62ff8f5d22c2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:15.094797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:15.100254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:15.100909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:15.101190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:15.101463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:15.102169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:15.102470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:15.103852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a9b97-70d0-434b-917a-2d6be5a1c040 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:15.114719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 591/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:15.120467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:15.173572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:15.220088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca6822-f96f-41a5-a63f-a068266d6dde None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:15.253091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:15.253759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:15.254050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:15.254333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:15.255070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:15.256530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb206-c597-4225-936e-545fc64a05ae None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:15.358734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 614/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 6 12:53:15 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:53:17.643615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44a6b4-cfc5-487b-bf45-3c91fa1224ed None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:17.644184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44a6b4-cfc5-487b-bf45-3c91fa1224ed None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:17.644184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44a6b4-cfc5-487b-bf45-3c91fa1224ed None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:17.645770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 592/1206] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:17.650993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:17.651424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:17.651583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:17.669297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:17.670545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:17.734968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 615/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:17.758257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44a6b4-cfc5-487b-bf45-3c91fa1224ed None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:17.858744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44a6b4-cfc5-487b-bf45-3c91fa1224ed None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:17.892039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:17.892848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:17.893139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:17.893411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:17.904297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:17.911858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:17.913040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:17.914066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:17.918061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 593/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:17.922830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:17.959016 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:18.018650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27162e-5128-4293-91c0-57318a44d83d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.053146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.053831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.054102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.054382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:18.055122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:18.055460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:18.060612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:18.065148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 616/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:18.070826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:18.122815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:18.170968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bab89-795e-4c5e-9868-c1d2a5cec254 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.332813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.333597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.333877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.334148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:18.345414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:18.349456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:18.364316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:18.365286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:18.366230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:18.366230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:18.366230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:18.366230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:18.366230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 594/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:18.371263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:18.470068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:18.472973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a22b-226b-4b59-9e1f-e31c9cc3cf40 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.507178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.507880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.508168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.508446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:18.509196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:18.509508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:18.510872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:18.522449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 617/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:18.528789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:18.630804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e438-f85f-45b2-9fa7-1744034473bb None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.632404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:18.664636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.665428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.665713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.665990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:18.673318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:18.674748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:18.689967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:18.691131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:18.692613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 595/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:18.696913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:18.798991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389c91-02e6-4662-9b33-9700bbc2f241 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.831434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.832127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.832413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.832690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:18.833520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:18.833830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:18.835247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:18.851941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 618/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:18.858524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:18.960730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc421a-9a1d-4d3a-8bd0-59229dc4398d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:18.994259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:18.994905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:18.995192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:18.995468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.024492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.062848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.064257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.159697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 596/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:53:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:53:19.165729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:19.185241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.268201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda8a2-ac23-4dd1-bfc0-bdd46f390928 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:19.302645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:19.303433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:19.303748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:19.304027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.314846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.316267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:19.333616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:19.334738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:19.341247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:19.341247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:19.341247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:19.341247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:19.341247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 619/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:19.341798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:19.402331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.439415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacd7f9-f733-4ba9-872e-c671a1c1d867 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:19.472208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:19.472944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:19.473222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:19.473496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.474195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:19.474497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.475862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.488011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 597/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:19.493791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:19.563331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.594315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d290bf-84b2-4523-b96e-9be6b5ba52fc None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:19.627632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:19.628415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:19.628700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:19.628979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.635634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.637067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:19.652095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:19.653879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:19.655374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 620/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:19.659667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:19.757950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a8a6-e718-49bc-8b44-5793cf6f9f37 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:19.781236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.792306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:19.792963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:19.793248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:19.793569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.794457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:19.794765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.796215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c46577-124b-4877-8713-851fa4c43e5b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.807521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 598/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:19.814303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:19.920313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31977d4d-bd00-4d02-9d50-1c6f05896673 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:19.948692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:19.954853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:19.955501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:19.955813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:19.956088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:19.956909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=1e9e09994be6462ca1d4f6be27d7a604) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:19.957219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:19.958641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e87c2-ea09-45db-a121-3167bf27f851 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:19.964114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 621/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:53:19 2022] GET /identity/v3/role_assignments?user.id=1e9e09994be6462ca1d4f6be27d7a604&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:22.213796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5feb-0837-4b18-b900-44559bdee761 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.214328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5feb-0837-4b18-b900-44559bdee761 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.214328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5feb-0837-4b18-b900-44559bdee761 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.216461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 599/1220] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:22.221898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.229158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.229158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.239956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:22.241141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:22.309037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 622/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:22.331792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5feb-0837-4b18-b900-44559bdee761 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:22.436768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5feb-0837-4b18-b900-44559bdee761 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:22.470856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:22.471607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.471894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.472172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.482363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:22.490126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:22.491192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:22.492422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 600/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:22.497414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:22.597073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb8fec-5de1-4350-ba76-1e2c268091f7 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:22.620195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:22.630877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:22.631561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.631848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.632124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.632858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] RBAC: Adding query filter params (name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:22.633173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:22.634512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:22.642642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 623/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:22.648948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:22.692242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:22.747496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c53ad-b682-4555-859d-1a00c9752a30 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:22.780913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:22.781692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.781975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.782251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.793074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:22.794531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:22.811976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:22.813075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:22.814177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:22.814177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:22.814177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:22.814177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:22.814177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 601/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:22.818916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:22.918224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac11173-029a-44a5-a0b2-a6d66c84b872 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:22.952767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:22.953431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:22.953745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:22.954022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:22.954735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:22.955044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:22.956502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:22.968467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 624/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:22.974118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.066360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:23.072930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae062d-a8eb-476a-af5f-9ba2d30d45ce None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.107070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.107884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.108168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.108440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.116511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.120845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:23.133149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:23.134404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:23.135842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 602/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:23.140330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.187613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:23.238679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e74f-064c-4422-8d97-9a95114a625a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.272694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.273356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.273638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.273914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.274733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:23.275041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.276501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.292980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 625/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:23.299318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.397880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc996b77-d690-488d-b0c2-6281bf01527d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.436834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.437620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.437960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.438236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.447992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.449500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:23.469591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:23.470778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:23.470778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:23.470778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:23.470778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:23.470778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 603/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:23.475385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.576114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a2d36-501c-4cff-9a81-762e3fec0c99 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.578385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:23.609291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.609956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.610240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.610517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.611235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:23.611569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.612921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.626564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 626/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:23.632186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.641579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:23.729626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596af7-33b6-4f70-a809-0cac408d772e None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.763006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.763761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.764023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.764297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.770789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.772507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:23.786395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:23.787416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:23.788666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:23.791689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 604/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:23.793337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:23.894918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725c70d-7936-42a1-ab3f-2f5f2d330485 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:23.928950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:23.929618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:23.929906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:23.930182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:23.930966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:23.931303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:23.932778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc58de-aa26-432e-9410-e572d0cfe581 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:23.945112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 627/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:23.951547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:24.016282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:24.051091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de754-e0d5-4d0e-b066-49959ef6aa3c None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:24.083747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:24.084881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:24.085355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:24.086076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/1e9e09994be6462ca1d4f6be27d7a604/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:24.100622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=1e9e09994be6462ca1d4f6be27d7a604, role_id=6d6c8f89be9d469e90fd3e0d1c75f6e0)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:24.102104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53037daf-a87f-4960-bb1e-88691f46ebeb None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:24.170186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 605/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:53:23 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/1e9e09994be6462ca1d4f6be27d7a604/roles/6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:53:26.430029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270d5-714f-48ca-a402-5d59c4be3591 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:26.430613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270d5-714f-48ca-a402-5d59c4be3591 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:26.430704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270d5-714f-48ca-a402-5d59c4be3591 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:26.432186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 628/1233] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:26.439564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:26.440025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:26.440116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:26.456994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:26.458188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:26.534003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 606/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:26.563043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9270d5-714f-48ca-a402-5d59c4be3591 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:26.595226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:26.683963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9270d5-714f-48ca-a402-5d59c4be3591 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:26.718488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:26.719283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:26.719588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:26.719869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:26.729971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:26.737973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:26.738952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:26.739964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 629/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 6 12:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:26.745415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:26.803283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:26.862375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b596f-65fd-4e26-a0c6-5a64bcf89b78 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:26.900217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:26.900885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:26.901211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:26.901763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:26.902219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] RBAC: Adding query filter params (name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:26.902538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:26.904285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:26.913746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 607/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 6 12:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:53:26.920826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.008861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:27.025606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbbd4c-def2-46f8-bca5-d44c920c7c02 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:27.063083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:27.063905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:27.064191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:27.064466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:27.074593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:27.076103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:27.093148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:27.099120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:27.100354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:27.100354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:27.100354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:27.100354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:27.100354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 630/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:27.100737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.202200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934d5a-0ff2-4ba9-8e6f-e18baeb84979 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:27.212301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:27.239248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:27.239937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:27.240226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:27.240507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:27.241223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:27.241534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:27.242908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:27.254783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 608/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:27.263488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.362933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3755f-64c4-4f0d-b8bc-98e9aa343b70 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:27.398001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:27.398801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:27.399085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:27.399366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:27.402172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:27.408383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:27.409867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:27.426439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:27.432082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:27.433297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 631/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:27.434029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.533588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dacd8-1108-4557-9430-5756e9008038 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:27.567543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:27.568368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:27.568657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:27.568933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:27.569789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:27.570100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:27.571542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:27.589574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 609/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:53:27.595576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.695988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba70d94-c40a-44c6-bb7b-faea6856a8a8 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:27.729671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:27.730315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:27.730720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:27.731015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:27.791507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:27.798668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:27.800157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:27.898069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 632/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:53:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:53:27.903936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:27.932098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:28.002229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f69c6-d36a-42c0-b018-2c8e56ac4299 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:28.035905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:28.036686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:28.036969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:28.037243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:28.047613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:28.048990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:28.065751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:28.066906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:28.068302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:28.068302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:28.068302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:28.068302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:28.068302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 610/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:28.072554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:28.166589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:28.172848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c18ed-1c98-437a-bbbb-6e1d99a7f1c0 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:28.205861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:28.206523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:28.206810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:28.207089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:28.207843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:28.208153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:28.209556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:28.221225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 633/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:28.226850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:28.305663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:28.329459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31005c3-df98-4828-b40c-f0127cb766f7 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:28.363420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:28.364257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:28.364537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:28.364806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:28.371197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:28.374985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:28.385848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:28.387030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:28.388626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 611/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:28.393850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:28.493724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d686-2323-40ae-a6fb-6921d01806e4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:28.527937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:28.529500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:28.529793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:28.530078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:28.530861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:28.531176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:28.532630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eec4b9-aeab-45fc-af0a-51decf363b96 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:28.544738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 634/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:28.552418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:28.648954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124502a-9cad-4d81-8fbc-51ff2f116c49 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:28.682277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:28.682929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:28.683235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:28.683512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:28.684365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] RBAC: Adding query filter params (role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=1e9e09994be6462ca1d4f6be27d7a604) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:28.684894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:28.686378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd5b4-faf1-4ebe-9517-a58d93ac4d13 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:28.692155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 612/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:53:28 2022] GET /identity/v3/role_assignments?user.id=1e9e09994be6462ca1d4f6be27d7a604&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=6d6c8f89be9d469e90fd3e0d1c75f6e0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:31.069460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af32f-59bb-4d35-ba43-75b9714eddf8 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.069993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af32f-59bb-4d35-ba43-75b9714eddf8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.070115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af32f-59bb-4d35-ba43-75b9714eddf8 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.071388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 635/1247] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:31.076619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.077072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.077225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.082233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:31.094543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:31.095747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:31.160284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 613/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:31.183836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af32f-59bb-4d35-ba43-75b9714eddf8 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:31.202264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:31.284428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af32f-59bb-4d35-ba43-75b9714eddf8 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:31.318613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:31.319394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.319710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.319988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.330345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:31.337809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:31.338978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:31.340275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 636/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:31.346275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:31.447625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c189f1-3337-4350-8118-58bcaeb1feb0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:31.478561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:31.483810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:31.484675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.484870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.485147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.485883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:31.486189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:31.487580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:31.495835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 614/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:31.502056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:31.583138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:31.606947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5b8ea-9536-4efd-8ab9-0478fb7345be None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:31.642007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:31.643107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.643416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.643720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.654405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:31.656949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:31.672757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:31.680795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:31.681925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:31.681925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:31.681925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:31.681925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:31.681925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 637/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:31.682302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:31.781308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f0ba-f415-40b4-b6cc-bcdc2e32d8e1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:31.814357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:31.815083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.815370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.815676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.816415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:31.816740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:31.818184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:31.830745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 615/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:31.836714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:31.942608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962852fe-bb1b-4620-be58-c07ced1d9ad1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:31.970420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:31.979676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:31.984571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:31.984571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:31.984571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:31.989361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:31.990863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:32.004926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:32.006070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:32.007261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 638/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:32.012063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:32.071399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:32.115943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3ec62-f2d7-411d-87e4-7ada0108d373 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:32.149638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:32.150288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:32.150572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:32.150903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:32.151759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:32.152122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:32.154274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.171800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 616/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:32.177580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:32.280974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6da6-d0e2-497f-80bf-cc223072866a None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:32.314067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:32.314723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:32.315008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:32.315285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:32.369661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:32.381457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:32.382906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.487065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 639/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:53:32.492766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:32.593750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39122b-5a56-4926-b4e4-15fb0facf0e2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:32.606408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:32.627469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:32.628275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:32.628560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:32.628854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:32.639220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:32.640700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:32.658602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:32.659814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:32.660846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:32.660846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:32.660846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:32.660846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:32.660846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 617/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:32.665508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:32.751944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:32.763179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77822e2-d915-4734-841c-8c0e7ecd1d28 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:32.797999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:32.798669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:32.798989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:32.799221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:32.799966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:32.800269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:32.801622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.813979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 640/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:32.819622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:32.920021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6554-41bb-4970-836f-ff663f0ef795 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:32.953770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:32.954552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:32.954855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:32.955123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:32.961613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:32.963033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:32.976802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:32.980451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:32.981695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 618/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:32.984162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:33.084053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447a85-f9db-44c1-a39c-a2c04896c8ed None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:33.117126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:33.117780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:33.118066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:33.118405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:33.119185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:33.119495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:33.120950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acd33d-dec9-4281-982e-e052b36d4a8d None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:33.133700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 641/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:33.140915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:33.168043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:33.244848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f23-b73e-46aa-9b61-b10b58587d65 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:33.277939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:33.279122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:33.279397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:33.279699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:33.280513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=1e9e09994be6462ca1d4f6be27d7a604) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:33.280820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:33.282230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebb843-13cb-42bf-95bc-dc7f27a79d5f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:33.287624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 619/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:53:33 2022] GET /identity/v3/role_assignments?user.id=1e9e09994be6462ca1d4f6be27d7a604&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:35.509100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd28ff-335c-4702-8d84-b9015ff9bdf8 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:35.509640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd28ff-335c-4702-8d84-b9015ff9bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:35.509640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd28ff-335c-4702-8d84-b9015ff9bdf8 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:35.511092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 642/1261] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:35.516762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:35.517159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:35.517313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:35.534806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:35.536067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:35.602356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 620/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:35.628294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd28ff-335c-4702-8d84-b9015ff9bdf8 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:35.639272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:35.729260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd28ff-335c-4702-8d84-b9015ff9bdf8 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:35.762275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:35.763005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:35.763283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:35.763578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:35.773583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:35.782019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:35.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:35.787360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 643/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:35.789965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:35.808776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:35.887326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37843ae8-6a90-4f1b-a4b6-aef595bf5cb3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:35.921528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:35.922192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:35.922472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:35.922743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:35.923474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:35.923837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:35.925334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:35.934044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 621/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:35.941145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.007627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:36.041992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d935e-ae9a-4fd1-a59a-273c338abf13 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.076032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.076821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.077102 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.077376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.087741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.089173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:36.106737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:36.107846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:36.108918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:36.108918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:36.108918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:36.108918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:36.108918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 644/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:36.115181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.197247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:36.217033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddc866-6b08-478a-818a-8029a66654a1 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.250683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.251339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.251653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.251929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.252642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:36.252949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.254300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.265917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 622/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:36.274109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.378109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03237a1c-1532-4578-90e5-2ea4a0181b92 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.398594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:36.412585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.413396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.413761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.414044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.422039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.423518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:36.439143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:36.443444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:36.444698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 645/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:36.446178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.549855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd63b86-0154-493a-af81-dc897b52db5d None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.590572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.591784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.592189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.592491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.593409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:36.593725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.595245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.604487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:36.613715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 623/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:36.619695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.722263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f77e3-6df5-43c1-bab5-415a0ce4d9a4 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.756043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.756836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.757119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.757395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.767956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.769432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:36.786168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:36.787397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:36.793407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:36.793407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:36.793407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:36.793407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:36.793407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 646/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:36.793846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.892617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036112bf-feb1-4dfb-b4c1-5090d757d8c2 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:36.928506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:36.929167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:36.929449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:36.929723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:36.930555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:36.930862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:36.932262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:36.944393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 624/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:36.950112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:36.982794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:37.050634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695d8c-06cf-4977-b0bc-50dff21fe82f None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:37.083184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:37.084029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:37.087830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:37.087830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:37.091741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:37.093259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:37.107546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:37.114240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:37.115218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 647/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:37.115864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:37.173064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:37.213027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595daf95-1dca-439b-8e99-9ea0612fd4dd None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:37.247354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:37.248036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:37.248326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:37.248595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:37.249365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:37.249698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:37.251114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f75b8b-1297-4519-ac58-21bdd4c3a74b None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:37.262738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 625/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:37.277816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:37.359698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:37.367903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e788-83e0-4987-b97c-5097294b892e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:37.400964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:37.401843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:37.402124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:37.402397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] PATH_INFO: `/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/1e9e09994be6462ca1d4f6be27d7a604/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:37.405146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] RBAC: Authorizing `identity:create_grant(project_id=3788f0ec7979494ea76673bf87d29e32, user_id=1e9e09994be6462ca1d4f6be27d7a604, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:37.409794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f6d6-8567-4cfb-9051-1e66b254eb74 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:37.532409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 648/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 6 12:53:37 2022] PUT /identity/v3/projects/3788f0ec7979494ea76673bf87d29e32/users/1e9e09994be6462ca1d4f6be27d7a604/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 12:53:39.803650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8b31-94bf-4219-99a4-35a43c53505b None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:39.832553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8b31-94bf-4219-99a4-35a43c53505b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:39.832553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c8b31-94bf-4219-99a4-35a43c53505b None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:39.832553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 626/1274] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:39.832870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:39.832870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:39.832870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:39.832870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:39.832870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:39.897048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 649/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:39.922203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8b31-94bf-4219-99a4-35a43c53505b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.021597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c8b31-94bf-4219-99a4-35a43c53505b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.038416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:40.054812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.055589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.055870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.056131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.066598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 12:53:40.074140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:40.075430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:40.077218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 627/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 6 12:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:40.081979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.162089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:40.179614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5382e-1cf3-47ba-9ddd-7f8630df4db3 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.213373 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.214032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.214315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.214588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.215319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:40.215685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:40.220278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:40.226458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 650/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:40.233177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.334650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915187-852e-4eec-bc4a-d686a963b491 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.368561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.369343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.369630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.369906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.380678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:40.382114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:40.399712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:40.400861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:40.402015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:40.402015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:40.402015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:40.402015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:40.402015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 628/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:40.407507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.506920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86d514-5d9d-4857-86c3-6ab7233bc27e None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.541264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.541919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.542208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.542491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.543206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:40.543519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:40.545842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:40.557264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 651/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:40.563707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.595909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:40.666747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011a1d-40e2-4040-a962-365b3a4878f6 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.703733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.704529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.704814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.705089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.712079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:40.713558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 12:53:40.728757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:40.729948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:40.731280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 629/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:40.736561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.740335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:40.833778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bee8-02a9-4fe0-8154-6b88a91eec63 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:40.867383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:40.868047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:40.868333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:40.868608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:40.869434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:40.869741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:40.871146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:40.888130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 652/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:40.893812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:40.986905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:40.996157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6f1f-5ee8-49e9-a8be-3e2e8f3613d9 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.029881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.030514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.030795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.031065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.096269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.097718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.183335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:41.193187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 630/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 6 12:53:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 12:53:41.198986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:41.262715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:41.302906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489cbdb-f6c7-45ef-8e8a-06c6c10f11c1 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.336710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.337491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.337779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.338057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.349461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.350890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 12:53:41.367772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:41.368880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:41.369882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 12:53:41.369882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 12:53:41.369882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 12:53:41.369882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:41.369882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 653/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 12:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:41.374980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:41.474213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770e1c-2c7e-4fd4-9f29-94954f78fb27 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.507743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.508399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.508688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.508968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.509677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:41.509988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.511355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.523641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 631/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 6 12:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:41.529451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:41.630940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8765f-f31b-4efa-85fc-9eb3c47a76cf None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.645450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:41.664874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.665668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.665955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.666234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.673167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.674610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 12:53:41.689269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:41.690441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: ERROR keystone.server.flask.application Jun 06 12:53:41.691579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 654/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 6 12:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:41.696296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:41.746905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:41.796627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518d55-01eb-4222-8011-551e590b08e3 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.830181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.830836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.831122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.831398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.832204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:41.832516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.833946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0027a-db0f-4b3a-8e31-d051abb84c18 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.846098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 632/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 6 12:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:41.852109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:41.954165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eab56-e99d-486b-86e3-19358172bf06 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:41.987595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:41.988304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:41.988592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:41.988872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:41.989721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] RBAC: Adding query filter params (role.id=32e86bbc786f4bd585e514ac1b5b2694, scope.project.id=3788f0ec7979494ea76673bf87d29e32, user.id=1e9e09994be6462ca1d4f6be27d7a604) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:41.990039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:41.991457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa00c7-05ae-460f-96b1-ec25833611b9 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:41.997363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 655/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 6 12:53:41 2022] GET /identity/v3/role_assignments?user.id=1e9e09994be6462ca1d4f6be27d7a604&scope.project.id=3788f0ec7979494ea76673bf87d29e32&role.id=32e86bbc786f4bd585e514ac1b5b2694 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:44.281304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63f31-ed9b-4713-81d7-fab22864c4bb None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:44.281838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63f31-ed9b-4713-81d7-fab22864c4bb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:44.281838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d63f31-ed9b-4713-81d7-fab22864c4bb None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:44.283167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 633/1288] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:44.288487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:44.288929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:44.289031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:44.306033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:44.307208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:44.337811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:44.375728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 656/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:44.399680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63f31-ed9b-4713-81d7-fab22864c4bb None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:44.500712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d63f31-ed9b-4713-81d7-fab22864c4bb None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:44.510897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:44.534017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:44.534743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:44.535025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:44.535296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:44.535963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:44.537397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:44.549709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:44.551018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:44.552183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:44.555677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 634/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:53:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:44.556979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:44.656725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128c47-5d53-4399-afc6-3743cf1f85ba None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:44.690474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:44.691160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:44.691443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:44.691747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:44.692446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:44.692753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:44.694109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099ad3-680f-40db-9c3f-005b110eb8a5 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:44.698913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 657/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 6 12:53:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:44.705403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:44.804691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884dc90-0609-43e1-8052-a9da5d6a8afe None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:44.838829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:44.839514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:44.839837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:44.840115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] PATH_INFO: `/v3/services` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:44.840815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:44.841127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:44.842634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f9bc5-ce19-42a3-ab0b-ff58bc73b14c None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:44.846988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 635/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 6 12:53:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:47.090691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130988b-f493-4341-92ac-14ecaa6b6e1c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:47.091773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130988b-f493-4341-92ac-14ecaa6b6e1c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:47.091773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130988b-f493-4341-92ac-14ecaa6b6e1c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:47.093549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 658/1293] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:47.099087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d722c-1167-4041-8cdd-b7798e917fe4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:47.099480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d722c-1167-4041-8cdd-b7798e917fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:47.099687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d722c-1167-4041-8cdd-b7798e917fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:47.116783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6e8d722c-1167-4041-8cdd-b7798e917fe4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:47.118129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6e8d722c-1167-4041-8cdd-b7798e917fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:47.147812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:47.183842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 636/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:47.208463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130988b-f493-4341-92ac-14ecaa6b6e1c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:47.240053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:47.308961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130988b-f493-4341-92ac-14ecaa6b6e1c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:47.343780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:47.344446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:47.344734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:47.345013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:47.345738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:47.347101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c35e1-e911-4e99-a13e-92e29e040591 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:47.423622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 659/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 6 12:53:47 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:53:49.700239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab7c3f-ba36-40b2-9e1b-5d264b124fc2 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:49.701294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab7c3f-ba36-40b2-9e1b-5d264b124fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:49.701294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab7c3f-ba36-40b2-9e1b-5d264b124fc2 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:49.702703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 637/1296] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:49.708080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:49.708520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:49.708652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:49.726194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:49.727378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:49.801399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 660/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:49.824755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab7c3f-ba36-40b2-9e1b-5d264b124fc2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:49.926541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab7c3f-ba36-40b2-9e1b-5d264b124fc2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:49.959591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:49.960338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:49.960619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:49.960898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:49.961546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:49.962916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:49.975161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:49.976467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:49.977358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 638/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:53:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:49.983256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:50.001268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:50.080096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb1dfc-fd26-475e-aff2-336a633fe3a9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:50.114192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:50.114922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:50.115161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:50.115441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:50.116183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:50.116499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:50.117889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:50.122970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 661/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 6 12:53:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:50.129206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:50.161130 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:50.228127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b14b9-b5b6-4b35-a06f-a5967063076f None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:50.261913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:50.262583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:50.262866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:50.263138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:50.263941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] RBAC: Adding query filter params (interface=public, service_id=f060ea5eae88462c8a0558f65dfb5a96, region_id=RegionOne) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:50.264248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:50.265601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e93e0-d087-4928-8520-4051ca561581 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:50.270467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 639/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 6 12:53:50 2022] GET /identity/v3/endpoints?service_id=f060ea5eae88462c8a0558f65dfb5a96&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 12:53:50.276394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:50.357826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:50.376077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e63a7-aa26-4e3c-a9c5-e51abdc45f25 None admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:50.409082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:50.409760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:50.410032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:50.410312 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:50.411032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:50.412418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf96878-383c-4e9c-bd99-dbb9640c6505 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:50.420049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 662/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 6 12:53:50 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 12:53:52.641232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8a74-3f48-42a4-95b1-0627e703415e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:52.641786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8a74-3f48-42a4-95b1-0627e703415e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:52.641786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8a74-3f48-42a4-95b1-0627e703415e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:52.643148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 640/1302] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:53:52.648277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:52.648909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:52.649098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:52.666180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:53:52.667359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:53:52.733836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 663/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:53:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 12:53:52.756970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8a74-3f48-42a4-95b1-0627e703415e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:52.851380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:52.858424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8a74-3f48-42a4-95b1-0627e703415e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:52.891991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:52.892708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:52.892991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:52.893281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:52.893925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:52.895303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 12:53:52.907680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 12:53:52.908868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application with Lock( Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self._enter() Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application return self.creator() Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application created_value = creator( Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: ERROR keystone.server.flask.application Jun 06 12:53:52.910099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 641/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 6 12:53:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 12:53:52.915008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:52.990646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:53:53.012258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3835-568b-4f9f-b4d2-641ff27d9f55 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:53.045468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:53.046128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:53.046406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:53.046681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] PATH_INFO: `/v3/services` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:53.047376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 12:53:53.047713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:53.049060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7d708-4697-4446-a983-1eac0a1cc0d4 None admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:53.054130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 664/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 6 12:53:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 12:53:53.060099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:53:53.160571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ea64e-f990-407c-8359-12bf2a8f3041 None admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:53:53.192335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:53:53.192977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:53:53.193258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:53:53.193534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:53:53.194293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:53:53.195714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad9d2b-ebfd-4e03-8112-537326878784 None admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:53:53.288174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 642/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 6 12:53:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 12:54:03.074996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=30 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:54:03.283479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:29.709031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752604-6dc6-4e56-b822-9f18483612d2 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:29.709600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752604-6dc6-4e56-b822-9f18483612d2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:29.709600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80752604-6dc6-4e56-b822-9f18483612d2 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:29.711166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 665/1307] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:29.716632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e027f-4297-45f0-a914-cb6dd867a317 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:29.717120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e027f-4297-45f0-a914-cb6dd867a317 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:29.717203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e027f-4297-45f0-a914-cb6dd867a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:29.846680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-650e027f-4297-45f0-a914-cb6dd867a317 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:29.847928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-650e027f-4297-45f0-a914-cb6dd867a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:30.062262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 643/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:30.114761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:30.115375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:30.115870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:30.117556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 666/1309] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jun 6 12:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:30.130070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aef22-0cc4-4fe1-8959-cd23205220c9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:30.130396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aef22-0cc4-4fe1-8959-cd23205220c9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:30.130648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aef22-0cc4-4fe1-8959-cd23205220c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:30.278351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-812aef22-0cc4-4fe1-8959-cd23205220c9 None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:30.280940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-812aef22-0cc4-4fe1-8959-cd23205220c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:30.318918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:30.395485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 644/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jun 6 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:30.404912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:30.407145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:30.606899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9569e-155f-4209-9b4b-9c7667c38036 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:30.693778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:30.694449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:30.694729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:30.695007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:30.696939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:30.756780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:30.826193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:30.827658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e89c8-6369-4e9c-9d88-97b9a68c0e89 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:30.848117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 667/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:33.435712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2b51-013d-4e1f-b810-dd12a2a8d935 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:33.436226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2b51-013d-4e1f-b810-dd12a2a8d935 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:33.436326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2b51-013d-4e1f-b810-dd12a2a8d935 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:33.437828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 645/1312] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:33.443456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279236c9-dd76-41e7-abe7-0204f4e78362 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:33.443912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279236c9-dd76-41e7-abe7-0204f4e78362 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:33.444291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279236c9-dd76-41e7-abe7-0204f4e78362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:33.530178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-279236c9-dd76-41e7-abe7-0204f4e78362 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:33.531820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-279236c9-dd76-41e7-abe7-0204f4e78362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:33.628357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 668/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:33.682715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:33.683089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:33.683376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:33.684757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 646/1314] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jun 6 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:33.690671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282320-6281-4bd3-baa7-b8f2e85e2361 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:33.690917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282320-6281-4bd3-baa7-b8f2e85e2361 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:33.691202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4282320-6281-4bd3-baa7-b8f2e85e2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:33.704274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:33.768857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c4282320-6281-4bd3-baa7-b8f2e85e2361 None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:33.769987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4282320-6281-4bd3-baa7-b8f2e85e2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:33.846928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 669/1315] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jun 6 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:33.856458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:33.858045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:33.986163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6f171-e9aa-4c72-9a0e-9ad066abe451 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:34.064997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:34.067507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:34.068180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:34.068467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:34.068744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:34.070399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:34.183971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:34.185408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1262-68c6-43fa-8e8b-f3e2b1d50aad service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:34.204020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 647/1316] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:37.198520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:37.199031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:37.199031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:37.200430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 670/1317] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:37.205788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf6a5-f683-4001-ab3d-07cc49eda31c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:37.206192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf6a5-f683-4001-ab3d-07cc49eda31c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:37.206349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf6a5-f683-4001-ab3d-07cc49eda31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:37.269976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a3bbf6a5-f683-4001-ab3d-07cc49eda31c None None] MFA Rules not processed for user `09093413150e4b37924a82390366a138`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:37.271217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a3bbf6a5-f683-4001-ab3d-07cc49eda31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:37.323786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:37.367461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 648/1318] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:37.407228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:37.408801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:37.511903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5dec-72e7-4a23-ac76-5b79b98797a3 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:37.514627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:37.584435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:37.585081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:37.585360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:37.585632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:37.587304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:37.691185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:37.692630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a48f7-23c1-43a4-af6d-164ae8b49319 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:37.712869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 671/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:40.922823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:40.923266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:40.923380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:40.924770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 649/1320] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:40.929835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02d45-5fef-4093-ab0b-c685bfd3dd88 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:40.930286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02d45-5fef-4093-ab0b-c685bfd3dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:40.930701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02d45-5fef-4093-ab0b-c685bfd3dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:40.972067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:40.995872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-13e02d45-5fef-4093-ab0b-c685bfd3dd88 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:40.997062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13e02d45-5fef-4093-ab0b-c685bfd3dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:41.091181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 672/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:41.131294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:41.132883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:41.245061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ed7c-3625-4c9c-bdb3-930b69ab5eef None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:41.318991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:41.319665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:41.320209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:41.320491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:41.322688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:41.330265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:41.435334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:41.436800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4124c28-cfa4-49ed-bfb1-e7356bc112be service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:41.454536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 650/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:44.765008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:44.765580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:44.765677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:44.767051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 673/1323] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:44.772458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6c7c-6bf5-4c24-a6b4-2f89ead25443 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:44.772859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6c7c-6bf5-4c24-a6b4-2f89ead25443 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:44.773016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6c7c-6bf5-4c24-a6b4-2f89ead25443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:44.838486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-979a6c7c-6bf5-4c24-a6b4-2f89ead25443 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:44.839712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-979a6c7c-6bf5-4c24-a6b4-2f89ead25443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:44.899835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:44.939014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 651/1324] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:44.975197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:44.976778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:45.081365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23ca06-b2b0-4120-ab0b-c2b676769a41 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:45.094448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:45.155740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:45.156654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:45.156939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:45.157217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:45.158847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:45.275991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:45.277429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491f406-1e3f-4ac0-8e36-b2eb1a4ccfc0 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:45.296051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 674/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:47.630466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:47.631080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:47.631080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:47.632411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 652/1326] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:47.638505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de971b3-67ae-4cf8-901c-2fb7dd82a801 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:47.638953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de971b3-67ae-4cf8-901c-2fb7dd82a801 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:47.639059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de971b3-67ae-4cf8-901c-2fb7dd82a801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:47.686217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:47.705180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8de971b3-67ae-4cf8-901c-2fb7dd82a801 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:47.706447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8de971b3-67ae-4cf8-901c-2fb7dd82a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:47.812306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 675/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:47.848696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:47.850240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:47.960076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78251b3-4ff2-46d0-a45d-7a52ccb7246c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:48.034262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:48.034910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:48.035195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:48.035472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:48.037148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:48.053943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:48.150169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:48.151641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85586e28-54f6-44e4-bfb8-356b59b60268 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:48.170102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 653/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:50.501746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8477-6243-418b-815e-8481be02431f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:50.502362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8477-6243-418b-815e-8481be02431f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:50.502362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8477-6243-418b-815e-8481be02431f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:50.503714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 676/1329] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:50.509244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593506-6d5f-4464-9337-d3dcaa05bfe0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:50.509672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593506-6d5f-4464-9337-d3dcaa05bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:50.509815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593506-6d5f-4464-9337-d3dcaa05bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:50.574669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-41593506-6d5f-4464-9337-d3dcaa05bfe0 None None] MFA Rules not processed for user `09093413150e4b37924a82390366a138`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:50.575914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-41593506-6d5f-4464-9337-d3dcaa05bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:50.641546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:50.673448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 654/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 12:59:50.715457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8477-6243-418b-815e-8481be02431f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:50.717082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bbae8477-6243-418b-815e-8481be02431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:50.823847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8477-6243-418b-815e-8481be02431f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:50.843689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:50.897567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:50.898215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:50.899128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:50.899415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:50.901081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:51.011234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:51.012712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21522685-299a-47a3-9d73-01f480739ad8 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:51.031624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 677/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:53.892097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:53.892632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:53.892816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:53.894015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 655/1332] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:53.899380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01f18-e395-433c-95e6-d3907ffde256 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:53.899852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01f18-e395-433c-95e6-d3907ffde256 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:53.899991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01f18-e395-433c-95e6-d3907ffde256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:53.965783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:53.968596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-68b01f18-e395-433c-95e6-d3907ffde256 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:53.969795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-68b01f18-e395-433c-95e6-d3907ffde256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:54.074652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 678/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:54.110012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:54.111605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:54.226970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f07d-0931-4339-ae18-e1573bfe0bb8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:54.314633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:54.315294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:54.315615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:54.315896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:54.317590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:54.348380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:54.456003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:54.457580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac30e62-6206-4961-a78c-ab8a172522b3 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:54.476813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 656/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 12:59:56.801437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:56.801923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:56.802220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:56.803641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 679/1335] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 12:59:56.809122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199775-0f72-433d-8180-bbb99213d4cb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:56.809550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199775-0f72-433d-8180-bbb99213d4cb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:56.809770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199775-0f72-433d-8180-bbb99213d4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:56.874873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b8199775-0f72-433d-8180-bbb99213d4cb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 12:59:56.876108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b8199775-0f72-433d-8180-bbb99213d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:56.950455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:56.974834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 657/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 12:59:57.016529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 12:59:57.018038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:57.118641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea277ec-96b1-4fdf-96e5-40c46f6d244f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 12:59:57.146026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:59:57.190311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 12:59:57.190978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 12:59:57.191257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 12:59:57.191547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 12:59:57.193165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 12:59:57.301035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 12:59:57.302466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e21bb-51a7-492c-847b-e7e52086e193 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 12:59:57.321733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 680/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:00.193829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:00.194339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:00.194339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:00.196420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 658/1338] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:00.201730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864f9c-a1a2-4f35-bbc6-666162b1afbd None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:00.202176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864f9c-a1a2-4f35-bbc6-666162b1afbd None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:00.202284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a864f9c-a1a2-4f35-bbc6-666162b1afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:00.267082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4a864f9c-a1a2-4f35-bbc6-666162b1afbd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:00.268310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4a864f9c-a1a2-4f35-bbc6-666162b1afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:00.276861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:00.367849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 681/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:00.404356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:00.408013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:00.521729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d69303-c202-436b-8a82-47d3ce95a69a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:00.525581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:00.526230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:00.526512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:00.526785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:00.528595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:00.630408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:00.631869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fd52e-675a-43ab-b917-22ba6a7a5e40 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:00.641890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:00.651090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 659/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:05.145081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6573d3-d43f-41d9-8e3a-329583168686 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:05.145560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6573d3-d43f-41d9-8e3a-329583168686 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:05.145643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6573d3-d43f-41d9-8e3a-329583168686 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:05.147149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 682/1341] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:05.152456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26634-10d3-473a-bb52-b6b2193fcad5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:05.156293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26634-10d3-473a-bb52-b6b2193fcad5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:05.156293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c26634-10d3-473a-bb52-b6b2193fcad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:05.202085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-72c26634-10d3-473a-bb52-b6b2193fcad5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:05.203213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-72c26634-10d3-473a-bb52-b6b2193fcad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:05.281908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 660/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:05.321164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6573d3-d43f-41d9-8e3a-329583168686 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:05.332842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6573d3-d43f-41d9-8e3a-329583168686 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:05.336952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:05.337585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:05.337869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:05.338143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:05.347387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:05.348866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f20b0-9f07-4826-b497-e4afb0bef90f service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:05.359229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 683/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:08.641322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c5b6-f880-4c61-a271-7894bc1adec6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:08.641848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c5b6-f880-4c61-a271-7894bc1adec6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:08.641941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c5b6-f880-4c61-a271-7894bc1adec6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:08.643251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 661/1344] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:08.649120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269223-b226-400b-b8d9-2c23c369118b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:08.649546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269223-b226-400b-b8d9-2c23c369118b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:08.649770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269223-b226-400b-b8d9-2c23c369118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:08.678135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2d269223-b226-400b-b8d9-2c23c369118b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:08.679854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2d269223-b226-400b-b8d9-2c23c369118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:08.688276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 684/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:00:08.727100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c5b6-f880-4c61-a271-7894bc1adec6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:08.737661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c5b6-f880-4c61-a271-7894bc1adec6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:08.741813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:08.742746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:08.743028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:08.743305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:08.752260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:08.753712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2902e5-31bb-450e-a1ee-9313657ee403 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:08.764268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 662/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:13.184931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6bde-e250-49bc-8341-4c86d29af560 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:13.185475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6bde-e250-49bc-8341-4c86d29af560 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:13.185475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6bde-e250-49bc-8341-4c86d29af560 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:13.186795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 685/1347] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:13.191974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164c6-721d-4a28-be8d-237a295b856e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:13.192399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164c6-721d-4a28-be8d-237a295b856e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:13.192531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee164c6-721d-4a28-be8d-237a295b856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:13.210834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7ee164c6-721d-4a28-be8d-237a295b856e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:13.212066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ee164c6-721d-4a28-be8d-237a295b856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:13.220055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 663/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:13.259318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6bde-e250-49bc-8341-4c86d29af560 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:13.270121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6bde-e250-49bc-8341-4c86d29af560 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:13.274510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:13.275272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:13.275651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:13.275998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:13.285301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:13.286837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a0a37-efe0-4cb6-a553-a7082633bb45 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:13.296464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 686/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:18.673071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f29b-9d67-4dce-b1e8-077ccf3b5452 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:18.673611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f29b-9d67-4dce-b1e8-077ccf3b5452 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:18.673836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f29b-9d67-4dce-b1e8-077ccf3b5452 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:18.675727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 664/1350] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:18.681059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ca3c-e3c4-40b7-bfd8-90739187b625 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:18.681955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ca3c-e3c4-40b7-bfd8-90739187b625 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:18.682684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ca3c-e3c4-40b7-bfd8-90739187b625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:18.757687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4e32ca3c-e3c4-40b7-bfd8-90739187b625 None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:18.759552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4e32ca3c-e3c4-40b7-bfd8-90739187b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:18.810675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:18.848158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 687/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:23.131324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7dce-c7e1-488b-8904-5d2e2b1f4d62 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:23.132053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7dce-c7e1-488b-8904-5d2e2b1f4d62 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:23.132053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7dce-c7e1-488b-8904-5d2e2b1f4d62 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:23.133514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 665/1352] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:23.138802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f6de-abcd-4be9-8c1e-82390d51e512 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:23.139242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f6de-abcd-4be9-8c1e-82390d51e512 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:23.139337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f6de-abcd-4be9-8c1e-82390d51e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:23.159068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-be57f6de-abcd-4be9-8c1e-82390d51e512 None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:23.160296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-be57f6de-abcd-4be9-8c1e-82390d51e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:23.170056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 688/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:23.205623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=56 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:24.846536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982254-ad8a-4650-88c9-17d36b7a37d6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:24.847167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982254-ad8a-4650-88c9-17d36b7a37d6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:24.847167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982254-ad8a-4650-88c9-17d36b7a37d6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:24.848478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 666/1354] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:24.853958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf25bb-8727-48fb-9d9a-4c1bbf07bb97 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:24.854389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf25bb-8727-48fb-9d9a-4c1bbf07bb97 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:24.854501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf25bb-8727-48fb-9d9a-4c1bbf07bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:24.873467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-06cf25bb-8727-48fb-9d9a-4c1bbf07bb97 None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:24.874659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-06cf25bb-8727-48fb-9d9a-4c1bbf07bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:24.884130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 689/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:28.753474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1aa7-daa6-4173-bf2e-9a2071f3e02c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:28.754071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1aa7-daa6-4173-bf2e-9a2071f3e02c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:28.754173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1aa7-daa6-4173-bf2e-9a2071f3e02c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:28.762186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960196b-acb2-4c43-b5eb-61abaf7710f3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:28.762716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 667/1356] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:28.763217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960196b-acb2-4c43-b5eb-61abaf7710f3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:28.763744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960196b-acb2-4c43-b5eb-61abaf7710f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:28.782733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4960196b-acb2-4c43-b5eb-61abaf7710f3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:28.784064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4960196b-acb2-4c43-b5eb-61abaf7710f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:28.796684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 690/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:00:28.853114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd135-7888-4dd0-8594-756a67ee4d28 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:28.853639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd135-7888-4dd0-8594-756a67ee4d28 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:28.854190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfd135-7888-4dd0-8594-756a67ee4d28 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:28.855760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 668/1358] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 6 13:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:28.864921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a8b-66a1-4dda-9ab2-e75b3a3ff8a3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:28.865598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a8b-66a1-4dda-9ab2-e75b3a3ff8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:28.866051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a8b-66a1-4dda-9ab2-e75b3a3ff8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:28.931268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-7d4b1a8b-66a1-4dda-9ab2-e75b3a3ff8a3 None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:28.932537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7d4b1a8b-66a1-4dda-9ab2-e75b3a3ff8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:29.027564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 691/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 6 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:00:29.035865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd135-7888-4dd0-8594-756a67ee4d28 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:29.052600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfd135-7888-4dd0-8594-756a67ee4d28 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:29.058457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:29.059200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:29.059491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:29.059801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:29.069084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:29.070652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc836a8-ee22-4600-bb14-b61c7ec5fc42 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:29.080347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 669/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:31.578233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9849bd-613c-4cc2-abbb-5cc832f090ef None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:31.578785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9849bd-613c-4cc2-abbb-5cc832f090ef None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:31.578785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9849bd-613c-4cc2-abbb-5cc832f090ef None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:31.580228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 692/1361] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:31.585971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1e708-83dc-46e1-8410-a6e616c402fa None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:31.586409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1e708-83dc-46e1-8410-a6e616c402fa None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:31.586526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1e708-83dc-46e1-8410-a6e616c402fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:31.605456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-63a1e708-83dc-46e1-8410-a6e616c402fa None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:31.606643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-63a1e708-83dc-46e1-8410-a6e616c402fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:31.614694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 670/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:31.659653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9849bd-613c-4cc2-abbb-5cc832f090ef None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:31.674643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9849bd-613c-4cc2-abbb-5cc832f090ef None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:31.680629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:31.681351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:31.681736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:31.682084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:31.690767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:31.692516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994652f-c93e-4f81-a172-fa214b1459ac service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:31.702489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 693/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:34.563406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07cb7-8960-4356-a4d8-9055baea04e4 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:34.563934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07cb7-8960-4356-a4d8-9055baea04e4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:34.563934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07cb7-8960-4356-a4d8-9055baea04e4 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:34.565327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 671/1364] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:34.570670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc95b0-0e97-4b90-bc5a-17e868eb9468 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:34.571108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc95b0-0e97-4b90-bc5a-17e868eb9468 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:34.571233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc95b0-0e97-4b90-bc5a-17e868eb9468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:34.589828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-06cc95b0-0e97-4b90-bc5a-17e868eb9468 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:34.591008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-06cc95b0-0e97-4b90-bc5a-17e868eb9468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:34.598767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 694/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:34.645063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234c03-1e86-4676-87a1-8375d57ff435 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:34.645567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234c03-1e86-4676-87a1-8375d57ff435 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:34.646498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234c03-1e86-4676-87a1-8375d57ff435 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:34.648064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 672/1366] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 6 13:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:34.653338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3047c-e884-4978-b24e-79d52a5aeb3d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:34.654442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3047c-e884-4978-b24e-79d52a5aeb3d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:34.654442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3047c-e884-4978-b24e-79d52a5aeb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:34.673361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-41f3047c-e884-4978-b24e-79d52a5aeb3d None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:34.674529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-41f3047c-e884-4978-b24e-79d52a5aeb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:34.683765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 695/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 6 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:00:34.691384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae234c03-1e86-4676-87a1-8375d57ff435 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:34.705840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae234c03-1e86-4676-87a1-8375d57ff435 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:34.711926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:34.712563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:34.712849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:34.713128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:34.721435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:34.723027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9acb72-97b9-41cd-9f59-0895fca32839 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:34.733448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 673/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:37.214000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d509-0edd-4b3a-9180-262eb2b76323 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.214564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d509-0edd-4b3a-9180-262eb2b76323 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.214564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d509-0edd-4b3a-9180-262eb2b76323 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.215922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 696/1369] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:37.221888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03dfd-dc2d-4f7f-a7a1-4dbc995d6efb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.222409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03dfd-dc2d-4f7f-a7a1-4dbc995d6efb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.222532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03dfd-dc2d-4f7f-a7a1-4dbc995d6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.242329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a6e03dfd-dc2d-4f7f-a7a1-4dbc995d6efb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:37.243577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6e03dfd-dc2d-4f7f-a7a1-4dbc995d6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:37.251906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 674/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:37.264814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb82df2-1d42-4eb6-888c-c808b13e43ac None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.265110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb82df2-1d42-4eb6-888c-c808b13e43ac None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.265395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb82df2-1d42-4eb6-888c-c808b13e43ac None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.266900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 697/1371] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:00:37.272202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6bd-0724-4daf-af51-ab4921df782c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.272502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6bd-0724-4daf-af51-ab4921df782c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.272781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6bd-0724-4daf-af51-ab4921df782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.292624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a226d6bd-0724-4daf-af51-ab4921df782c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:37.293888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a226d6bd-0724-4daf-af51-ab4921df782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:37.296308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb82df2-1d42-4eb6-888c-c808b13e43ac None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:37.302768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 675/1372] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:37.312181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb82df2-1d42-4eb6-888c-c808b13e43ac None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:37.317941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:37.318725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.319075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.319416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.328448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:37.330101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e7a05-c93d-4239-a3c8-3e0d323b2db0 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:37.340450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 698/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:37.584091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64056-0e2e-4d62-bebb-ba9a5446f909 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.584377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64056-0e2e-4d62-bebb-ba9a5446f909 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.584876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64056-0e2e-4d62-bebb-ba9a5446f909 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.586353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 676/1374] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jun 6 13:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:37.592197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf5fd-3e6f-42c4-8644-8e0c630c3cc9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.592740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf5fd-3e6f-42c4-8644-8e0c630c3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.595273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf5fd-3e6f-42c4-8644-8e0c630c3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.652759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:37.657303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8e8bf5fd-3e6f-42c4-8644-8e0c630c3cc9 None None] MFA Rules not processed for user `c8839b9c0fca4cffb2bae93393cb7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:37.658950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8e8bf5fd-3e6f-42c4-8644-8e0c630c3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:37.729362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 699/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jun 6 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:37.737203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64056-0e2e-4d62-bebb-ba9a5446f909 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:37.750700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64056-0e2e-4d62-bebb-ba9a5446f909 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:37.754312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:37.755650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:37.755938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:37.756212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:37.766237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:37.767702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092cf51-b702-4909-993b-c49e1515eb14 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:37.778160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 677/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:39.791911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a686-d633-46eb-8513-05ea59bee583 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:39.792443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a686-d633-46eb-8513-05ea59bee583 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:39.792443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a686-d633-46eb-8513-05ea59bee583 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:39.793818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 700/1377] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:39.799762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796345-66cf-4bba-a283-38fe62dfa95d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:39.800309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796345-66cf-4bba-a283-38fe62dfa95d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:39.800309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796345-66cf-4bba-a283-38fe62dfa95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:39.819437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d5796345-66cf-4bba-a283-38fe62dfa95d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:39.820721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d5796345-66cf-4bba-a283-38fe62dfa95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:39.828804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 678/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:39.875082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a686-d633-46eb-8513-05ea59bee583 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:39.890116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a686-d633-46eb-8513-05ea59bee583 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:39.896699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:39.897355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:39.897645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:39.897929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:39.908829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:39.910574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eee8d-2a38-403a-8564-ffe12e695493 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:39.922035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 701/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:00:42.347246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a515-28ac-44f1-91ef-f3503c08f015 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:42.347812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a515-28ac-44f1-91ef-f3503c08f015 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:42.347812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a515-28ac-44f1-91ef-f3503c08f015 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:42.349740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 679/1380] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:42.355182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0437-0efd-4510-904c-f254426ffcd1 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:42.355662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0437-0efd-4510-904c-f254426ffcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:42.355662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0437-0efd-4510-904c-f254426ffcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:42.374132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-11da0437-0efd-4510-904c-f254426ffcd1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:42.375349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-11da0437-0efd-4510-904c-f254426ffcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:42.384564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 702/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:42.428490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149a515-28ac-44f1-91ef-f3503c08f015 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:42.444229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149a515-28ac-44f1-91ef-f3503c08f015 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:42.449941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:42.450665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:42.451016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:42.451366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:42.460299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:42.461958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713a01a-c34a-496f-8542-5b3f13e721cf service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:42.471945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 680/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:44.910106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020eca-aa4a-4e5f-9034-890354e83e7a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:44.911581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020eca-aa4a-4e5f-9034-890354e83e7a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:44.911881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020eca-aa4a-4e5f-9034-890354e83e7a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:44.913436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 703/1383] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:44.919072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b34dc-0016-4773-868c-cec0d1e00ced None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:44.919992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b34dc-0016-4773-868c-cec0d1e00ced None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:44.920341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b34dc-0016-4773-868c-cec0d1e00ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:44.938544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d16b34dc-0016-4773-868c-cec0d1e00ced None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:44.939903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d16b34dc-0016-4773-868c-cec0d1e00ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:44.948410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 681/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:44.991156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020eca-aa4a-4e5f-9034-890354e83e7a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:45.006695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020eca-aa4a-4e5f-9034-890354e83e7a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:45.012132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:45.012775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:45.013060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:45.013465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:45.023261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:45.024945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e5a4-2d25-48d3-b2c0-3f544169ecd3 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:45.035057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 704/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:47.671416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851643-10ed-4ad9-ada5-38ea0de93b08 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:47.672065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851643-10ed-4ad9-ada5-38ea0de93b08 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:47.672065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851643-10ed-4ad9-ada5-38ea0de93b08 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:47.673505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 682/1386] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:00:47.680837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829f54-9aa2-4fd8-b002-8b84bdf48962 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:47.681330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829f54-9aa2-4fd8-b002-8b84bdf48962 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:47.681570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829f54-9aa2-4fd8-b002-8b84bdf48962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:47.702611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0f829f54-9aa2-4fd8-b002-8b84bdf48962 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:47.703910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0f829f54-9aa2-4fd8-b002-8b84bdf48962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:47.712463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 705/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:47.760967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d851643-10ed-4ad9-ada5-38ea0de93b08 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:47.779847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d851643-10ed-4ad9-ada5-38ea0de93b08 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:47.787816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:47.788697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:47.789059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:47.789415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:47.800169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:47.802246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b9896-2077-4de4-a068-f1e004641b4a service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:47.813118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 683/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:50.308568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39b47-80e8-4626-ac63-2021fa7da965 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:50.309131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39b47-80e8-4626-ac63-2021fa7da965 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:50.309131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39b47-80e8-4626-ac63-2021fa7da965 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:50.310482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 706/1389] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:50.317074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d0f6-6a30-4291-ae27-f03801ffe772 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:50.317628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d0f6-6a30-4291-ae27-f03801ffe772 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:50.317974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d0f6-6a30-4291-ae27-f03801ffe772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:50.338717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4a79d0f6-6a30-4291-ae27-f03801ffe772 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:50.340239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4a79d0f6-6a30-4291-ae27-f03801ffe772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:50.360776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 684/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:50.404327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39b47-80e8-4626-ac63-2021fa7da965 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:50.420645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39b47-80e8-4626-ac63-2021fa7da965 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:50.426802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:50.427453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:50.427763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:50.428034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:50.436909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:50.438479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590673f-a009-4b5d-bd41-590517920cd8 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:50.448644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 707/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:52.877906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2f1-5ec8-42d1-adf1-057c55f46885 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:52.878524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2f1-5ec8-42d1-adf1-057c55f46885 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:52.878524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2f1-5ec8-42d1-adf1-057c55f46885 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:52.880038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 685/1392] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:52.885575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee109-98e8-4e60-8bfb-71df15ac8d36 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:52.886021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee109-98e8-4e60-8bfb-71df15ac8d36 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:52.886258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee109-98e8-4e60-8bfb-71df15ac8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:52.904761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-483ee109-98e8-4e60-8bfb-71df15ac8d36 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:52.906214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-483ee109-98e8-4e60-8bfb-71df15ac8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:52.915115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 708/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:52.959025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e2f1-5ec8-42d1-adf1-057c55f46885 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:52.973922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e2f1-5ec8-42d1-adf1-057c55f46885 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:52.979365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:52.980028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:52.980315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:52.980595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:52.989375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:52.990946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd5b80-485e-485d-ab0e-ec7528132083 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:53.000529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 686/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:54.025649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180e0d-4cd5-4802-bc6f-ad5b011cd564 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.026202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180e0d-4cd5-4802-bc6f-ad5b011cd564 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.026336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180e0d-4cd5-4802-bc6f-ad5b011cd564 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:54.028123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 709/1395] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:54.033819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a144-396a-4094-9fce-f50100eaf300 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.034216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a144-396a-4094-9fce-f50100eaf300 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.034390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a144-396a-4094-9fce-f50100eaf300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:54.040825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=55 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:54.052785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e560a144-396a-4094-9fce-f50100eaf300 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:54.059647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e560a144-396a-4094-9fce-f50100eaf300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:54.062002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 687/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:54.119858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18557-ff26-490f-ad34-3e14c459e2bf None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.120156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18557-ff26-490f-ad34-3e14c459e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.120439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18557-ff26-490f-ad34-3e14c459e2bf None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:54.121804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 710/1397] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jun 6 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:54.127109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffb76-8789-4e8e-ac9f-4c66cd254c6e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.127406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffb76-8789-4e8e-ac9f-4c66cd254c6e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.127730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fffb76-8789-4e8e-ac9f-4c66cd254c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:54.178307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-09fffb76-8789-4e8e-ac9f-4c66cd254c6e None None] MFA Rules not processed for user `d74ba06aac5c41fb84b55297050305ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:54.179435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-09fffb76-8789-4e8e-ac9f-4c66cd254c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:54.241473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 688/1398] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jun 6 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:54.248973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd18557-ff26-490f-ad34-3e14c459e2bf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:54.261031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd18557-ff26-490f-ad34-3e14c459e2bf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:54.264589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:54.265245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.265534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.265815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:54.276054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:54.277495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d5b60-68ac-4302-8273-9b0ad1e63f47 service glance] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:54.288847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 711/1399] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:54.961553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0057c5-4dd4-448c-899d-e45b9196d31f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:54.961852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0057c5-4dd4-448c-899d-e45b9196d31f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:54.962138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0057c5-4dd4-448c-899d-e45b9196d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.010661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ed0057c5-4dd4-448c-899d-e45b9196d31f None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:55.011821 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ed0057c5-4dd4-448c-899d-e45b9196d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:55.078188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 689/1400] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:55.120925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb817bb-4d19-45a4-9c86-01dad53df781 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.121395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb817bb-4d19-45a4-9c86-01dad53df781 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.121651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb817bb-4d19-45a4-9c86-01dad53df781 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.123108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 712/1401] 10.222.0.13 () {54 vars in 942 bytes} [Mon Jun 6 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:55.129341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9711d-e72e-4dbf-b4cb-a23281a8c772 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.129664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9711d-e72e-4dbf-b4cb-a23281a8c772 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.129950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9711d-e72e-4dbf-b4cb-a23281a8c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.179539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-79b9711d-e72e-4dbf-b4cb-a23281a8c772 None None] MFA Rules not processed for user `b2ec321b639b467595aa54be55e84956`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:55.180762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-79b9711d-e72e-4dbf-b4cb-a23281a8c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:55.194169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:55.253228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 690/1402] 10.222.0.13 () {58 vars in 1039 bytes} [Mon Jun 6 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:55.263146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb817bb-4d19-45a4-9c86-01dad53df781 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:55.277380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb817bb-4d19-45a4-9c86-01dad53df781 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:55.283086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:55.283766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.284057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.284338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.293115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:55.294693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b3567-72b5-4daf-a285-cf7d7d34f3d8 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:55.303498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 713/1403] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:00:55.418102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04cfe-47d2-405e-922e-cdcc0b0432ad None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.418414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04cfe-47d2-405e-922e-cdcc0b0432ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.418696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04cfe-47d2-405e-922e-cdcc0b0432ad None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.420115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 691/1404] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:00:55.425486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb87-9aca-4899-9c0b-47bb060a668e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.426525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb87-9aca-4899-9c0b-47bb060a668e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.426815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807fb87-9aca-4899-9c0b-47bb060a668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.444942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f807fb87-9aca-4899-9c0b-47bb060a668e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:55.448077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f807fb87-9aca-4899-9c0b-47bb060a668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:55.454120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 714/1405] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:55.498483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04cfe-47d2-405e-922e-cdcc0b0432ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:55.512935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04cfe-47d2-405e-922e-cdcc0b0432ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:55.518398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:55.518977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:55.519277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:55.519598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:55.527772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:55.532205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b4f3-feee-4271-81a0-97a6a5861dfc service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:55.539613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 692/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:00:58.021799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8a12-3a2a-478c-90d7-ea1c07c6ef17 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:58.022377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8a12-3a2a-478c-90d7-ea1c07c6ef17 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:58.022377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa8a12-3a2a-478c-90d7-ea1c07c6ef17 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:58.023772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 715/1407] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:00:58.028989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cede-6e99-44d7-b727-3e0853c72d62 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:58.029434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cede-6e99-44d7-b727-3e0853c72d62 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:58.029612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cede-6e99-44d7-b727-3e0853c72d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:58.048698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-81f3cede-6e99-44d7-b727-3e0853c72d62 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:00:58.049915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-81f3cede-6e99-44d7-b727-3e0853c72d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:00:58.058851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 693/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:00:58.106038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa8a12-3a2a-478c-90d7-ea1c07c6ef17 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:00:58.121145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa8a12-3a2a-478c-90d7-ea1c07c6ef17 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:00:58.127687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:00:58.128338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:00:58.128679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:00:58.129026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:00:58.138198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:00:58.139863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7761-096f-4a7b-a781-e6b71b7aeb75 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:00:58.150377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 716/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:08.043807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=33 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:08.145783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=72 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:19.547877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286912ee-690f-4eb4-87b7-82c3fcdbbe8d None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:19.548472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286912ee-690f-4eb4-87b7-82c3fcdbbe8d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:19.548472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286912ee-690f-4eb4-87b7-82c3fcdbbe8d None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:19.549834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 694/1410] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jun 6 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:19.555519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea512f-8a4a-45a4-ac89-a6db5bd5adaf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:19.555984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea512f-8a4a-45a4-ac89-a6db5bd5adaf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:19.556201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea512f-8a4a-45a4-ac89-a6db5bd5adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:19.574120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dcea512f-8a4a-45a4-ac89-a6db5bd5adaf None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:19.575318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dcea512f-8a4a-45a4-ac89-a6db5bd5adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:19.584248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 717/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jun 6 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:19.598003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d2a2-1bd6-4a9d-b642-7d0d38ddc4bc None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:19.598290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d2a2-1bd6-4a9d-b642-7d0d38ddc4bc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:19.599051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d2a2-1bd6-4a9d-b642-7d0d38ddc4bc None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:19.600583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 695/1412] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jun 6 13:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:19.605343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51c86-c7eb-42e2-bcaa-30f2d9f8ed03 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:19.605641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51c86-c7eb-42e2-bcaa-30f2d9f8ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:19.605929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b51c86-c7eb-42e2-bcaa-30f2d9f8ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:19.624215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-94b51c86-c7eb-42e2-bcaa-30f2d9f8ed03 None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:19.625398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-94b51c86-c7eb-42e2-bcaa-30f2d9f8ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:19.634786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 718/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jun 6 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:22.371751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f928a6-6ab3-4f1e-a5e8-30253d9a1430 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:22.372313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f928a6-6ab3-4f1e-a5e8-30253d9a1430 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:22.372313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f928a6-6ab3-4f1e-a5e8-30253d9a1430 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:22.373624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:22.379234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2776-e84f-4dbf-9e98-c82f61081624 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:22.380195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2776-e84f-4dbf-9e98-c82f61081624 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:22.380382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2776-e84f-4dbf-9e98-c82f61081624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:22.398386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-333a2776-e84f-4dbf-9e98-c82f61081624 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:22.399613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-333a2776-e84f-4dbf-9e98-c82f61081624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:22.407645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:22.450167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f928a6-6ab3-4f1e-a5e8-30253d9a1430 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:22.465465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f928a6-6ab3-4f1e-a5e8-30253d9a1430 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:22.470960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:22.471628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:22.471943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:22.472220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:22.480757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:22.482341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113f1d-b470-4748-90ee-f1dc5df4a368 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:22.492195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 697/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:23.468466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d831-f7da-4513-9155-15a569bbbc14 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:23.469039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d831-f7da-4513-9155-15a569bbbc14 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:23.469039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d831-f7da-4513-9155-15a569bbbc14 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:23.470389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:23.475893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6b61-6b0c-447e-94a9-5e7b78513d68 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:23.476346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6b61-6b0c-447e-94a9-5e7b78513d68 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:23.476467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf6b61-6b0c-447e-94a9-5e7b78513d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:23.494588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-aebf6b61-6b0c-447e-94a9-5e7b78513d68 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:23.495822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aebf6b61-6b0c-447e-94a9-5e7b78513d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:23.503449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:23.671595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857d831-f7da-4513-9155-15a569bbbc14 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:23.685456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857d831-f7da-4513-9155-15a569bbbc14 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:23.690661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:23.691291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:23.691612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:23.691887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:23.699828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:23.701403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03224101-4172-434f-a49c-c9712f099e57 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:23.711075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 721/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:24.643052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d11-5a47-48a4-8d03-23b04fb77d01 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:24.643655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d11-5a47-48a4-8d03-23b04fb77d01 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:24.643655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d11-5a47-48a4-8d03-23b04fb77d01 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:24.645041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:24.650085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f588-c921-42dc-a2fa-f161176c8f05 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:24.650510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f588-c921-42dc-a2fa-f161176c8f05 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:24.650641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f588-c921-42dc-a2fa-f161176c8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:24.669221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a322f588-c921-42dc-a2fa-f161176c8f05 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:24.670394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a322f588-c921-42dc-a2fa-f161176c8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:24.679585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:24.826985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7d11-5a47-48a4-8d03-23b04fb77d01 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:24.841419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7d11-5a47-48a4-8d03-23b04fb77d01 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:24.846722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:24.847351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:24.847661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:24.847935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:24.856562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:24.858128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdda9-2ef3-417b-8f76-5d8bbe6b4f3d service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:24.868132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 700/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:25.771203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c7190-2323-4d16-8228-841b3b6b48c6 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:25.771844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c7190-2323-4d16-8228-841b3b6b48c6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:25.771844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c7190-2323-4d16-8228-841b3b6b48c6 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:25.773173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:25.778005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d35a-4980-43b9-88d7-1c101a3693e8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:25.778402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d35a-4980-43b9-88d7-1c101a3693e8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:25.778554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d35a-4980-43b9-88d7-1c101a3693e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:25.796962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ef14d35a-4980-43b9-88d7-1c101a3693e8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:25.798159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef14d35a-4980-43b9-88d7-1c101a3693e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:25.805952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:25.954329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c7190-2323-4d16-8228-841b3b6b48c6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:25.968980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c7190-2323-4d16-8228-841b3b6b48c6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:25.974863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:25.975493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:25.975810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:25.976090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:25.984075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:25.985678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519eef-3737-4988-9383-47f38a28cb56 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:25.994912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 724/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:26.896780 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7254-2652-41df-a20c-118358de0ba1 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:26.897356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7254-2652-41df-a20c-118358de0ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:26.897458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7254-2652-41df-a20c-118358de0ba1 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:26.898981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:26.904097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370431-e760-445e-9733-4396b7715c32 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:26.904824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370431-e760-445e-9733-4396b7715c32 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:26.904936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370431-e760-445e-9733-4396b7715c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:26.923833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-85370431-e760-445e-9733-4396b7715c32 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:26.925031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-85370431-e760-445e-9733-4396b7715c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:26.933759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:27.086748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7254-2652-41df-a20c-118358de0ba1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:27.101448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7254-2652-41df-a20c-118358de0ba1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:27.106879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:27.107516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:27.107849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:27.108112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:27.116675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:27.118251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe14de-037d-43e6-a711-f86a4ff700dd service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:27.127607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 703/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:28.042275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f935-aa55-4731-96c5-620f53bebe3a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:28.042871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f935-aa55-4731-96c5-620f53bebe3a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:28.042871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f935-aa55-4731-96c5-620f53bebe3a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:28.044322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:28.050068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999404b1-8244-40fa-86e4-bf08560defa8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:28.050486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999404b1-8244-40fa-86e4-bf08560defa8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:28.051039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999404b1-8244-40fa-86e4-bf08560defa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:28.070288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-999404b1-8244-40fa-86e4-bf08560defa8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:28.071490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-999404b1-8244-40fa-86e4-bf08560defa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:28.079296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:28.234456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f935-aa55-4731-96c5-620f53bebe3a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:28.248896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f935-aa55-4731-96c5-620f53bebe3a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:28.254058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:28.255394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:28.255702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:28.255976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:28.263863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:28.265423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5f3d-8e43-4967-a18b-29d5f864e48d service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:28.275035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 727/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:29.224756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a863-bfb2-43e1-8c30-6f1c6720ce7e None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:29.225291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a863-bfb2-43e1-8c30-6f1c6720ce7e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:29.225291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a863-bfb2-43e1-8c30-6f1c6720ce7e None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:29.226647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:29.231596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8714a-8149-4716-a7e4-b6b3dc04f47c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:29.232037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8714a-8149-4716-a7e4-b6b3dc04f47c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:29.232144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8714a-8149-4716-a7e4-b6b3dc04f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:29.250565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ccf8714a-8149-4716-a7e4-b6b3dc04f47c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:29.251791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ccf8714a-8149-4716-a7e4-b6b3dc04f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:29.259982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:29.408813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a863-bfb2-43e1-8c30-6f1c6720ce7e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:29.423864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a863-bfb2-43e1-8c30-6f1c6720ce7e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:29.430033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:29.430673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:29.430961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:29.431240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:29.439452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:29.441081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293af64-3aa5-425a-9155-25a3883959e9 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:29.451051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 706/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:30.369170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1b6d-2591-4567-8a70-d47d208b7496 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:30.369694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1b6d-2591-4567-8a70-d47d208b7496 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:30.369801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1b6d-2591-4567-8a70-d47d208b7496 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:30.371100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:30.376257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686364-c41a-40e8-a113-15e18cf32a7b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:30.376658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686364-c41a-40e8-a113-15e18cf32a7b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:30.380258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686364-c41a-40e8-a113-15e18cf32a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:30.396648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e9686364-c41a-40e8-a113-15e18cf32a7b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:30.398531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e9686364-c41a-40e8-a113-15e18cf32a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:30.406008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:30.555753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1b6d-2591-4567-8a70-d47d208b7496 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:30.571311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1b6d-2591-4567-8a70-d47d208b7496 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:30.576833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:30.577472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:30.577758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:30.578034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:30.586433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:30.588089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd824e-6af1-4667-b903-7b31c155e7ea service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:30.597704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 730/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:31.503276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd501-55e9-43ee-ae87-df17abb15b9a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:31.503898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd501-55e9-43ee-ae87-df17abb15b9a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:31.504808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd501-55e9-43ee-ae87-df17abb15b9a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:31.506186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:31.511266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1938ea-acd9-4e70-beff-0b4dd3b1de57 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:31.511684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1938ea-acd9-4e70-beff-0b4dd3b1de57 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:31.511898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1938ea-acd9-4e70-beff-0b4dd3b1de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:31.530533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0f1938ea-acd9-4e70-beff-0b4dd3b1de57 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:31.531809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0f1938ea-acd9-4e70-beff-0b4dd3b1de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:31.539811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:31.690306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd501-55e9-43ee-ae87-df17abb15b9a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:31.704982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd501-55e9-43ee-ae87-df17abb15b9a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:31.711225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:31.711893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:31.712175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:31.712445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:31.720441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:31.722002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed58d-24ad-45e2-ba5c-59249e93c0ed service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:31.731302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 709/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:33.915916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dbba-f7a7-45ee-8ba3-7df1364e1c0a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:33.916435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dbba-f7a7-45ee-8ba3-7df1364e1c0a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:33.916565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dbba-f7a7-45ee-8ba3-7df1364e1c0a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:33.917865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:33.923911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb48e7-eba4-4ff0-8441-c1f00b5b740a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:33.924335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb48e7-eba4-4ff0-8441-c1f00b5b740a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:33.924448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb48e7-eba4-4ff0-8441-c1f00b5b740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:33.944418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f1eb48e7-eba4-4ff0-8441-c1f00b5b740a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:33.945653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f1eb48e7-eba4-4ff0-8441-c1f00b5b740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:33.953469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:33.998911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23dbba-f7a7-45ee-8ba3-7df1364e1c0a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:34.010747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23dbba-f7a7-45ee-8ba3-7df1364e1c0a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:34.014304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:34.015089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:34.015469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:34.015782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:34.026872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:34.029665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafd85d-22c8-4b10-9992-fb680091267a service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:34.041980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 733/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:01:36.515629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97546-e722-4abc-9890-bc67392d0aa6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:36.516171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97546-e722-4abc-9890-bc67392d0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:36.516171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97546-e722-4abc-9890-bc67392d0aa6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:36.517522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:36.523477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623694bd-3dbd-4177-8a4b-23f8a0440438 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:36.523927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623694bd-3dbd-4177-8a4b-23f8a0440438 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:36.524091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623694bd-3dbd-4177-8a4b-23f8a0440438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:36.542625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-623694bd-3dbd-4177-8a4b-23f8a0440438 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:36.543851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-623694bd-3dbd-4177-8a4b-23f8a0440438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:36.551567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:36.589826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a97546-e722-4abc-9890-bc67392d0aa6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:36.601071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a97546-e722-4abc-9890-bc67392d0aa6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:36.604595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:36.605224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:36.605505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:36.605777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:36.614567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:36.616009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2904-b6e3-4632-8aaa-1e16e2a5fe10 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:36.625156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 712/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:39.234465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:39.235091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:39.235091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:39.236491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:39.242547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4fe7-a77b-4faa-a221-790d2c3d407b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:39.243007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4fe7-a77b-4faa-a221-790d2c3d407b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:39.243122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e4fe7-a77b-4faa-a221-790d2c3d407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:39.260466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b25e4fe7-a77b-4faa-a221-790d2c3d407b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:39.261644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b25e4fe7-a77b-4faa-a221-790d2c3d407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:39.269738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:39.309744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:39.311439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:39.324628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62038a-2744-4ae4-a749-2516aacd0b9a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:39.328230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:39.328874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:39.329162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:39.329442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:39.339161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:39.340630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc9a4-bb33-44ab-96fb-a2bf4344d59b service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:39.350926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 736/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:41.748636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917ef3-f3a6-4ce8-b6e2-68c1df4946ef None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:41.749223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917ef3-f3a6-4ce8-b6e2-68c1df4946ef None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:41.749223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d917ef3-f3a6-4ce8-b6e2-68c1df4946ef None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:41.750589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:41.756549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473767a8-8970-43b7-984b-32b5b45227ab None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:41.756995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473767a8-8970-43b7-984b-32b5b45227ab None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:41.757114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473767a8-8970-43b7-984b-32b5b45227ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:41.774480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-473767a8-8970-43b7-984b-32b5b45227ab None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:41.775688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-473767a8-8970-43b7-984b-32b5b45227ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:41.783475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:41.822386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d917ef3-f3a6-4ce8-b6e2-68c1df4946ef None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:41.832955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d917ef3-f3a6-4ce8-b6e2-68c1df4946ef None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:41.836457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:41.837085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:41.837368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:41.837652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:41.846410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:41.847848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bf4d-1b05-45e8-af00-b230386df60a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:41.857551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 715/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:44.218041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d15a-2972-4e9c-8a7e-8e3c0fe64e6c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:44.218566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d15a-2972-4e9c-8a7e-8e3c0fe64e6c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:44.218566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d15a-2972-4e9c-8a7e-8e3c0fe64e6c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:44.219984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:44.225608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8616-d082-4665-97d5-083c1d9bbf42 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:44.226056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8616-d082-4665-97d5-083c1d9bbf42 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:44.226162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8616-d082-4665-97d5-083c1d9bbf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:44.244070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5bbb8616-d082-4665-97d5-083c1d9bbf42 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:44.245262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5bbb8616-d082-4665-97d5-083c1d9bbf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:44.252932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:44.290563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30d15a-2972-4e9c-8a7e-8e3c0fe64e6c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:44.301175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30d15a-2972-4e9c-8a7e-8e3c0fe64e6c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:44.305586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:44.306226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:44.306520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:44.306801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:44.315688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:44.317122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8247e72-108b-47d9-bb26-47fff73dbaf1 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:44.326732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 739/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:46.631614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ccd84-f9aa-4a9f-8af2-fd2470b396c6 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:46.632180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ccd84-f9aa-4a9f-8af2-fd2470b396c6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:46.632180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ccd84-f9aa-4a9f-8af2-fd2470b396c6 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:46.633522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:01:46.638925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f5027-3786-4943-9f92-158fb1fb7e0d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:46.639354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f5027-3786-4943-9f92-158fb1fb7e0d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:46.639489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f5027-3786-4943-9f92-158fb1fb7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:46.658650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e74f5027-3786-4943-9f92-158fb1fb7e0d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:46.659887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e74f5027-3786-4943-9f92-158fb1fb7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:46.667703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:01:46.705880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ccd84-f9aa-4a9f-8af2-fd2470b396c6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:46.717138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ccd84-f9aa-4a9f-8af2-fd2470b396c6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:46.720655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:46.721286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:46.721569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:46.721845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:46.730579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:46.732070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc22a97-6be0-4154-8d01-b78aaf4ed596 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:46.742434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 718/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:01:49.020187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce194d-799d-4011-90bd-62570f54f217 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:49.020813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce194d-799d-4011-90bd-62570f54f217 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:49.020813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce194d-799d-4011-90bd-62570f54f217 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:49.022104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:49.027419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09610b0-d934-48eb-85a2-5cfca2bbde99 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:49.027907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09610b0-d934-48eb-85a2-5cfca2bbde99 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:49.028058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09610b0-d934-48eb-85a2-5cfca2bbde99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:49.034319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=70 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:49.046123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e09610b0-d934-48eb-85a2-5cfca2bbde99 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:49.047316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e09610b0-d934-48eb-85a2-5cfca2bbde99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:49.055771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:49.093582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce194d-799d-4011-90bd-62570f54f217 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:49.098969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=73 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:49.105524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce194d-799d-4011-90bd-62570f54f217 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:49.109575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:49.109759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:49.110009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:49.110290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:49.121134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:49.123114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4c5c5-c5fb-4c2f-a868-b3b912c9a26f service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:49.134576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 742/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:51.427164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c8a0-10a7-4004-ac4b-593ee844b086 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:51.427793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c8a0-10a7-4004-ac4b-593ee844b086 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:51.427793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c8a0-10a7-4004-ac4b-593ee844b086 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:51.429116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:51.434535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d5f2-cbb5-4e73-8ba0-36cf25047dbf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:51.434945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d5f2-cbb5-4e73-8ba0-36cf25047dbf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:51.435099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d5f2-cbb5-4e73-8ba0-36cf25047dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:51.453321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8068d5f2-cbb5-4e73-8ba0-36cf25047dbf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:51.454588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8068d5f2-cbb5-4e73-8ba0-36cf25047dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:51.462670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:51.499967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39c8a0-10a7-4004-ac4b-593ee844b086 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:51.511127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39c8a0-10a7-4004-ac4b-593ee844b086 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:51.514595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:51.515219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:51.515500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:51.515805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:51.524541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:51.525963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb732f-8590-4d61-a798-aae6f97bf61d service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:51.535790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 721/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:53.842265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722a2a1-4937-4af1-848d-6ad1ae5d6d3b None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:53.842834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722a2a1-4937-4af1-848d-6ad1ae5d6d3b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:53.842834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722a2a1-4937-4af1-848d-6ad1ae5d6d3b None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:53.844247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:53.850481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016e4f-e85c-4249-ac0f-15d3ff23ed7f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:53.850914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016e4f-e85c-4249-ac0f-15d3ff23ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:53.851021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016e4f-e85c-4249-ac0f-15d3ff23ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:53.868896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-80016e4f-e85c-4249-ac0f-15d3ff23ed7f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:53.870077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-80016e4f-e85c-4249-ac0f-15d3ff23ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:53.877646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:53.914521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722a2a1-4937-4af1-848d-6ad1ae5d6d3b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:53.925082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722a2a1-4937-4af1-848d-6ad1ae5d6d3b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:53.929584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:53.930220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:53.930506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:53.930784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:53.939686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:53.941114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a879bc-f6e7-46ec-9e1d-4ce266ae2e27 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:53.950652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 745/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:56.309245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4ecf-054d-44df-91ef-fd1e15c15750 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:56.309786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4ecf-054d-44df-91ef-fd1e15c15750 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:56.309786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4ecf-054d-44df-91ef-fd1e15c15750 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:56.311089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:01:56.317306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91498a2-c610-4442-aa82-bce0d1e663d0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:56.324170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91498a2-c610-4442-aa82-bce0d1e663d0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:56.324170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91498a2-c610-4442-aa82-bce0d1e663d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:56.335665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e91498a2-c610-4442-aa82-bce0d1e663d0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:01:56.336874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e91498a2-c610-4442-aa82-bce0d1e663d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:01:56.344517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:01:56.380931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4ecf-054d-44df-91ef-fd1e15c15750 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:01:56.391552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4ecf-054d-44df-91ef-fd1e15c15750 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:01:56.395884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:01:56.396517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:01:56.396804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:01:56.397078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:01:56.406192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:01:56.407668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373889a-f0ae-4ce3-8bf9-3c1ac68a56f4 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:01:56.417078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 724/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:02:06.330119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=17 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:02:06.412950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=17 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:02:29.532211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61fd3-21c3-4986-ad7d-1dad61e9a4c4 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:29.532849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61fd3-21c3-4986-ad7d-1dad61e9a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:29.532849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a61fd3-21c3-4986-ad7d-1dad61e9a4c4 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:29.534896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 747/1471] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:29.540096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f0c7-9e31-4681-957c-e8264fbc574a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:29.540528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f0c7-9e31-4681-957c-e8264fbc574a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:29.540644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f0c7-9e31-4681-957c-e8264fbc574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:29.558311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9686f0c7-9e31-4681-957c-e8264fbc574a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:29.559506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9686f0c7-9e31-4681-957c-e8264fbc574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:29.567511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 725/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:29.615251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a977db-4dd6-4741-aec8-60b084b5849f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:29.615555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a977db-4dd6-4741-aec8-60b084b5849f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:29.615845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a977db-4dd6-4741-aec8-60b084b5849f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:29.617196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 748/1473] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jun 6 13:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:29.622145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03f70-be24-4cac-80b5-73cf4572bbc9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:29.622443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03f70-be24-4cac-80b5-73cf4572bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:29.622727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03f70-be24-4cac-80b5-73cf4572bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:29.640336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cea03f70-be24-4cac-80b5-73cf4572bbc9 None None] MFA Rules not processed for user `d74ba06aac5c41fb84b55297050305ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:29.641524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cea03f70-be24-4cac-80b5-73cf4572bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:29.648566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 726/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jun 6 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:29.656009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a977db-4dd6-4741-aec8-60b084b5849f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:29.667246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a977db-4dd6-4741-aec8-60b084b5849f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:29.670751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:29.671384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:29.671694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:29.671977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:29.681146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:29.682571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cbc41-de49-43cd-80ac-a23a5b080e13 service glance] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:29.692192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 749/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:32.033858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfffb-6a76-4f4a-a360-a3cb4813eb94 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:32.034375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfffb-6a76-4f4a-a360-a3cb4813eb94 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:32.034375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bfffb-6a76-4f4a-a360-a3cb4813eb94 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:32.035699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 727/1476] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:32.040871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd552-70db-4987-92cc-b9032340e605 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:32.041306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd552-70db-4987-92cc-b9032340e605 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:32.041442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cd552-70db-4987-92cc-b9032340e605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:32.060288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-d01cd552-70db-4987-92cc-b9032340e605 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:32.061488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d01cd552-70db-4987-92cc-b9032340e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:32.069923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 750/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:32.092838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bfffb-6a76-4f4a-a360-a3cb4813eb94 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:32.105792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bfffb-6a76-4f4a-a360-a3cb4813eb94 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:32.110266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:32.110924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:32.111759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:32.112038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:32.112764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:32.114461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:02:32.114461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:02:32.114461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:02:32.115608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df2b63-2005-4713-8764-4f6f94eed6cd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:32.134724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 728/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 6 13:02:32 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:02:34.489739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a3a6-bb4d-43dd-8ec3-0c8eb5f389b1 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:34.490326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a3a6-bb4d-43dd-8ec3-0c8eb5f389b1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:34.490326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a3a6-bb4d-43dd-8ec3-0c8eb5f389b1 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:34.492143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 751/1479] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:34.497216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f157-4694-41de-9516-f8143e6b3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:34.497646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f157-4694-41de-9516-f8143e6b3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:34.497762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f157-4694-41de-9516-f8143e6b3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:34.515866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4851f157-4694-41de-9516-f8143e6b3ff4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:34.517680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4851f157-4694-41de-9516-f8143e6b3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:34.525556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 729/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:34.570270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a3a6-bb4d-43dd-8ec3-0c8eb5f389b1 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:34.584794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a3a6-bb4d-43dd-8ec3-0c8eb5f389b1 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:34.590250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:34.590883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:34.591229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:34.591595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:34.600144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:34.601798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b100ed-81d4-4dda-9a08-eed5b025959d service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:34.612258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 752/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:37.025218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c361-0e1f-49e2-acbd-be7390a9f748 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:37.025777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c361-0e1f-49e2-acbd-be7390a9f748 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:37.025777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c361-0e1f-49e2-acbd-be7390a9f748 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:37.027118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 730/1482] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:37.032567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666a77-3068-40ae-accb-b4fad651dee1 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:37.033269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666a77-3068-40ae-accb-b4fad651dee1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:37.033269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666a77-3068-40ae-accb-b4fad651dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:37.051454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5a666a77-3068-40ae-accb-b4fad651dee1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:37.052688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5a666a77-3068-40ae-accb-b4fad651dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:37.060606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 753/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:37.097352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c361-0e1f-49e2-acbd-be7390a9f748 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:37.108038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c361-0e1f-49e2-acbd-be7390a9f748 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:37.112310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:37.112949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:37.113236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:37.113515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:37.122351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:37.123816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0734-83a8-4bc6-8492-e9fdfdb5107e service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:37.135940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 731/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:39.440874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0593bea-d04b-4323-b6ea-a135f8cd5a6d None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:39.441418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0593bea-d04b-4323-b6ea-a135f8cd5a6d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:39.441418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0593bea-d04b-4323-b6ea-a135f8cd5a6d None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:39.442791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 754/1485] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:39.448161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a199-e6d3-469c-9624-dbf266c7b243 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:39.448588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a199-e6d3-469c-9624-dbf266c7b243 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:39.448727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a199-e6d3-469c-9624-dbf266c7b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:39.466710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2b10a199-e6d3-469c-9624-dbf266c7b243 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:39.467939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2b10a199-e6d3-469c-9624-dbf266c7b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:39.476312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 732/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:39.513094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0593bea-d04b-4323-b6ea-a135f8cd5a6d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:39.524337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0593bea-d04b-4323-b6ea-a135f8cd5a6d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:39.528070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:39.528703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:39.529013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:39.529292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:39.539263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:39.540723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5863245-a10d-408f-8c2f-bbc5e23d1383 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:39.550601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 755/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:41.858148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0db25-acca-421f-bd99-967cf517b98c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:41.858755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0db25-acca-421f-bd99-967cf517b98c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:41.858755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0db25-acca-421f-bd99-967cf517b98c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:41.860093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 733/1488] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:41.866106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f73f5-a301-4f2c-89e7-ecd2a46d8388 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:41.866577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f73f5-a301-4f2c-89e7-ecd2a46d8388 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:41.866681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f73f5-a301-4f2c-89e7-ecd2a46d8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:41.884853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1e8f73f5-a301-4f2c-89e7-ecd2a46d8388 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:41.886046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1e8f73f5-a301-4f2c-89e7-ecd2a46d8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:41.894320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 756/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:41.933782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0db25-acca-421f-bd99-967cf517b98c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:41.945116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0db25-acca-421f-bd99-967cf517b98c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:41.948685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:41.949324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:41.949610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:41.949889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:41.959517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:41.960964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a55c-9c19-4b1a-8452-aa8b597674cc service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:41.970296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 734/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:44.613169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600985-4d9d-42ca-a348-5515aff9a26c None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:44.613764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600985-4d9d-42ca-a348-5515aff9a26c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:44.613764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600985-4d9d-42ca-a348-5515aff9a26c None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:44.615098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 757/1491] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 6 13:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:02:44.620289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1fd1-dc2e-4f6f-a928-18ea0f8d0cb2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:44.620752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1fd1-dc2e-4f6f-a928-18ea0f8d0cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:44.620875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1fd1-dc2e-4f6f-a928-18ea0f8d0cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:44.639099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b5b1fd1-dc2e-4f6f-a928-18ea0f8d0cb2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:02:44.640334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b5b1fd1-dc2e-4f6f-a928-18ea0f8d0cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:02:44.648314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 735/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 6 13:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:02:44.687404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600985-4d9d-42ca-a348-5515aff9a26c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:02:44.698450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600985-4d9d-42ca-a348-5515aff9a26c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:02:44.701905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:02:44.702559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:02:44.702843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:02:44.703116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:02:44.712430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:02:44.713842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503c3e-3e92-4ece-a25e-2ed2a4fa21f8 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:02:44.723050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 758/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:02:54.634036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=33 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:02:54.719467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=33 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:04:41.591431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:41.592061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:41.592061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:41.609791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:04:41.610998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:41.618832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 736/1494] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:04:41.626746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:41.627228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:41.627324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:41.645538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:04:41.646719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:41.655337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 759/1495] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:04:41.659677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:41.669560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a1ac-ccb8-46e1-83b5-fa58c50aa08b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:41.674073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:41.674729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:41.675042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:41.675322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:41.676144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:04:41.676461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:41.677474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:41.677474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:04:41.677474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:04:41.678346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:41.690003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 737/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:04:41.698716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:41.707992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9d5f-9c4c-465d-bd08-ffa5d9a93c60 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:41.712567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:41.713985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:41.714461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:41.714753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:41.715448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:41.717192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:41.717192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:04:41.717192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:04:41.718392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:41.850883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 760/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:04:41 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:04:41.855260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:41.865248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02522810-8536-4833-8abb-654d9809a186 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:41.926011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:41.926679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:41.926963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:41.927246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:41.927966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:41.928981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:41.928981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:04:41.928981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:04:41.930176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.008511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 738/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:04:41 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:04:42.013184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:42.023272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786375fc-46dd-48ca-9523-23277ea044f0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:42.030986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:42.030986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.030986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.030986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.031394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:42.031394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:42.031394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:04:42.031394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:04:42.031741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.044491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 761/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:04:42.048315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:42.058665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a9d15-eb23-473d-9ab2-61c450b48299 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:42.065440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:42.065440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.065440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.065440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.065872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:42.066060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:42.066060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:04:42.066060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:04:42.066920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3771a-5f37-4688-900e-deb414920e10 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.080750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 739/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:04:42.084961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:42.094911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091e1f-808e-4302-9e5f-0fc8fe156004 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:42.099375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:42.100281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.100569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.100847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] PATH_INFO: `/v3/projects/efdbacbf961742a5885003902692abf6/users/2bd818857928407ca63817ae48363599/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.116887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdbacbf961742a5885003902692abf6, user_id=2bd818857928407ca63817ae48363599, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:42.117847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:42.117847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:04:42.117847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:04:42.120618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d5b8-6af0-4f0f-bf89-a975fb9052d3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.235690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 762/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:04:42 2022] PUT /identity/v3/projects/efdbacbf961742a5885003902692abf6/users/2bd818857928407ca63817ae48363599/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:04:42.248874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b0c5-cff8-4c51-b548-d2cdfba20210 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.249170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b0c5-cff8-4c51-b548-d2cdfba20210 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.249453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b0c5-cff8-4c51-b548-d2cdfba20210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.275764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7b40b0c5-cff8-4c51-b548-d2cdfba20210 None None] MFA Rules not processed for user `2bd818857928407ca63817ae48363599`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:04:42.277285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7b40b0c5-cff8-4c51-b548-d2cdfba20210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:42.341109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 740/1502] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:04:42.355065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d662-8426-44ae-ad44-7b78b57852b5 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.355363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d662-8426-44ae-ad44-7b78b57852b5 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.355689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d662-8426-44ae-ad44-7b78b57852b5 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.357069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 763/1503] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jun 6 13:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:04:42.361968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312afb-38f9-4992-a6ca-e250974cfb15 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.362262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312afb-38f9-4992-a6ca-e250974cfb15 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.362541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312afb-38f9-4992-a6ca-e250974cfb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.381074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bd312afb-38f9-4992-a6ca-e250974cfb15 None None] MFA Rules not processed for user `c8839b9c0fca4cffb2bae93393cb7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:04:42.382278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bd312afb-38f9-4992-a6ca-e250974cfb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:42.425843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:04:42.433744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 741/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jun 6 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:04:42.442875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0d662-8426-44ae-ad44-7b78b57852b5 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:42.452439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0d662-8426-44ae-ad44-7b78b57852b5 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:42.455990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:42.456624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.456909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.457187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.465797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:42.467215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.476019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 764/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:04:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:04:42.524472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcbb4-b58f-4ddf-ba87-e5d45380d420 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.524782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcbb4-b58f-4ddf-ba87-e5d45380d420 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.525064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fcbb4-b58f-4ddf-ba87-e5d45380d420 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.527500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 742/1506] 10.222.0.13 () {52 vars in 829 bytes} [Mon Jun 6 13:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:04:42.531092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:42.593268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88d321-2fa1-4ca3-ad1b-35902130734c service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:42.597848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:42.598717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:42.599005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:42.599282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] PATH_INFO: `/v3/users/2bd818857928407ca63817ae48363599` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:42.600497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd818857928407ca63817ae48363599)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:42.601504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:42.601504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:04:42.601504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:04:42.602772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:42.936843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd818857928407ca63817ae48363599'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:42.938145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd818857928407ca63817ae48363599'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:42.997357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd818857928407ca63817ae48363599'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:43.015478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd818857928407ca63817ae48363599'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:43.023802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:04:43.028685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd818857928407ca63817ae48363599'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:43.034644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 765/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:04:42 2022] DELETE /identity/v3/users/2bd818857928407ca63817ae48363599 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:04:43.039143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:43.039636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:43.039748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:43.058256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:04:43.059600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:43.118277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 743/1508] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:04:43.128413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:43.129819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:43.188620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9e21-cbba-4020-844b-0c2a335c5367 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:43.192736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:43.193403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:43.193893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:43.194208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:43.205480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:43.206973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ec089-21c2-43c9-9c55-8f10c1fa0bcd service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:43.219757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 766/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:04:43.751741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:04:43.753995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:04:43.774747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a43a21-57be-4815-8714-3ed4640a8903 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:04:43.781807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:04:43.783254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:04:43.783757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:04:43.784249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] PATH_INFO: `/v3/projects/efdbacbf961742a5885003902692abf6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:04:43.786235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdbacbf961742a5885003902692abf6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:04:43.787445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:04:43.787445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:04:43.787445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:04:43.788963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:04:43.934191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdbacbf961742a5885003902692abf6', 'request_id': 'req-a1d8867d-9e4c-4d27-a7c0-87e994c33139'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:43.948212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdbacbf961742a5885003902692abf6', 'request_id': 'req-a1d8867d-9e4c-4d27-a7c0-87e994c33139'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:44.020456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdbacbf961742a5885003902692abf6', 'request_id': 'req-a1d8867d-9e4c-4d27-a7c0-87e994c33139'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:44.032467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] The token cache is being invalidate because project efdbacbf961742a5885003902692abf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:04:44.032760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:44.033392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1d8867d-9e4c-4d27-a7c0-87e994c33139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:04:44.035071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 744/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:04:43 2022] DELETE /identity/v3/projects/efdbacbf961742a5885003902692abf6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:04:53.213082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=29 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:04:54.029096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:20.353967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:20.354526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:20.354526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:20.357154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:20.362053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19cb3c-4cd5-4815-a71a-015d3a6dce45 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:20.362521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19cb3c-4cd5-4815-a71a-015d3a6dce45 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:20.362640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19cb3c-4cd5-4815-a71a-015d3a6dce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:20.384042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9e19cb3c-4cd5-4815-a71a-015d3a6dce45 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:20.385260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9e19cb3c-4cd5-4815-a71a-015d3a6dce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:20.443959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:06:20.618279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:20.620127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:20.694376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d12d1-f75e-46fb-9182-3d497c1b0322 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:20.699696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:20.700332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:20.700614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:20.700889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:20.708891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:20.710534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d0e1-fb9a-414d-9c55-ec5353f101b1 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:20.719737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 768/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:21.601519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19004c02-f853-4133-8e99-e113a3762ded None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:21.602088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19004c02-f853-4133-8e99-e113a3762ded None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:21.602088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19004c02-f853-4133-8e99-e113a3762ded None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:21.603503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:21.608501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3217d-5703-4d3c-b364-49c32f0a97b3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:21.608907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3217d-5703-4d3c-b364-49c32f0a97b3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:21.609073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3217d-5703-4d3c-b364-49c32f0a97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:21.628148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-65d3217d-5703-4d3c-b364-49c32f0a97b3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:21.629350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-65d3217d-5703-4d3c-b364-49c32f0a97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:21.638062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:21.750176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482ca6-fc53-4487-bb16-ede3d26aa2ac None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:21.750575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482ca6-fc53-4487-bb16-ede3d26aa2ac None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:21.750863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482ca6-fc53-4487-bb16-ede3d26aa2ac None None] PATH_INFO: `/v3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:21.752187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 747/1516] 10.222.0.46 () {54 vars in 925 bytes} [Mon Jun 6 13:06:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:06:21.758618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580975d-47b4-4631-a913-055c1580e284 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:21.758853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580975d-47b4-4631-a913-055c1580e284 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:21.759135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580975d-47b4-4631-a913-055c1580e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:21.778440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2580975d-47b4-4631-a913-055c1580e284 None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:21.779658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2580975d-47b4-4631-a913-055c1580e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:21.793984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63482ca6-fc53-4487-bb16-ede3d26aa2ac None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:21.809288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63482ca6-fc53-4487-bb16-ede3d26aa2ac None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:21.814791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:21.815430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:21.815766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:21.816040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:21.825234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:21.826815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cb2ad-aca4-4dcd-98b8-34db94be9ac0 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:21.836362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 748/1517] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:06:21.846254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 770/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Jun 6 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:25.955993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b174a-c790-4384-9ed9-1e510157e95a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:25.956511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b174a-c790-4384-9ed9-1e510157e95a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:25.956646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b174a-c790-4384-9ed9-1e510157e95a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:25.957879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 749/1519] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jun 6 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:25.963002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d1c5-1e37-4192-a691-93c1fe90f3de None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:25.963418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d1c5-1e37-4192-a691-93c1fe90f3de None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:25.963663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d1c5-1e37-4192-a691-93c1fe90f3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:25.981901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-23d1d1c5-1e37-4192-a691-93c1fe90f3de None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:25.983091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-23d1d1c5-1e37-4192-a691-93c1fe90f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:25.991478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 771/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jun 6 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:25.999679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b174a-c790-4384-9ed9-1e510157e95a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:26.012843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b174a-c790-4384-9ed9-1e510157e95a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:26.017706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:26.018330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:26.018612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:26.018948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:26.027223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:26.028819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f5a0c-0bd7-4f39-9141-99fedfdcbe44 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:26.038209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 750/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:06:33.117532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa9b6-90c6-4b6d-b1e8-6b46e991d545 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:33.118074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa9b6-90c6-4b6d-b1e8-6b46e991d545 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:33.118195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa9b6-90c6-4b6d-b1e8-6b46e991d545 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:33.119510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:33.124214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bec5-8a2c-401a-a5b5-3df43f41be71 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:33.124677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bec5-8a2c-401a-a5b5-3df43f41be71 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:33.124779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bec5-8a2c-401a-a5b5-3df43f41be71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:33.143170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8f07bec5-8a2c-401a-a5b5-3df43f41be71 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:33.144392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8f07bec5-8a2c-401a-a5b5-3df43f41be71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:33.153334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:33.305395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa9b6-90c6-4b6d-b1e8-6b46e991d545 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:33.320067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa9b6-90c6-4b6d-b1e8-6b46e991d545 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:33.325394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:33.326024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:33.326308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:33.326583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:33.335486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:33.337114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fe32d-7072-4728-81a5-1eac26a3ed45 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:33.348219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 773/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:34.235567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bda3-3742-4446-aa5b-4b8d50b9ffe8 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:34.235983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bda3-3742-4446-aa5b-4b8d50b9ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:34.236160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117bda3-3742-4446-aa5b-4b8d50b9ffe8 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:34.237536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 13:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:34.242622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d384b5-bd4b-4fa1-b260-6e37c725ecde None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:34.243051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d384b5-bd4b-4fa1-b260-6e37c725ecde None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:34.243186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d384b5-bd4b-4fa1-b260-6e37c725ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:34.260944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-26d384b5-bd4b-4fa1-b260-6e37c725ecde None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:34.262134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-26d384b5-bd4b-4fa1-b260-6e37c725ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:34.269765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:06:34.418859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117bda3-3742-4446-aa5b-4b8d50b9ffe8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:34.433618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117bda3-3742-4446-aa5b-4b8d50b9ffe8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:34.438876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:34.439503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:34.439813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:34.440089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:34.448894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:34.450551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6810b-b990-48cf-8014-a811d76abb01 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:34.460012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 753/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:38.451320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:38.451910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:38.451910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:38.453305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:38.458609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548534-4a85-410c-b7c9-d8e8c52f99b2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:38.459014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548534-4a85-410c-b7c9-d8e8c52f99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:38.459175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548534-4a85-410c-b7c9-d8e8c52f99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:38.477716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-dd548534-4a85-410c-b7c9-d8e8c52f99b2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:38.478930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dd548534-4a85-410c-b7c9-d8e8c52f99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:38.486872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:38.527222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:38.529011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:38.582831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:38.587236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521a12-dd1f-4e54-9c76-65ff9763e7f1 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:38.590798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:38.591462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:38.591778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:38.592057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:38.601697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:38.610533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be433fd5-42dc-4532-abf3-ff672fba6e3e service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:38.612435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 776/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:40.847255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f151-74d4-432d-9566-91636d56bfe7 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:40.847871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f151-74d4-432d-9566-91636d56bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:40.847971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f151-74d4-432d-9566-91636d56bfe7 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:40.849276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:06:40.855018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451311-e1d5-4687-99b3-333c27ac7942 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:40.855454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451311-e1d5-4687-99b3-333c27ac7942 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:40.855617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92451311-e1d5-4687-99b3-333c27ac7942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:40.873246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-92451311-e1d5-4687-99b3-333c27ac7942 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:40.874446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-92451311-e1d5-4687-99b3-333c27ac7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:40.882778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:40.917961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f151-74d4-432d-9566-91636d56bfe7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:40.929484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f151-74d4-432d-9566-91636d56bfe7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:40.933051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:40.933688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:40.933975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:40.934261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:40.943252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:40.945522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdebb2-2587-4e31-895e-409d09ab40a3 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:40.954946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 756/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:44.675636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:44.676202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:44.676202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:44.677586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:44.682878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f791fa-e220-48cc-91d9-0c1ece333658 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:44.683335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f791fa-e220-48cc-91d9-0c1ece333658 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:44.683614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f791fa-e220-48cc-91d9-0c1ece333658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:44.689865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=58 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:44.701806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a9f791fa-e220-48cc-91d9-0c1ece333658 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:44.703029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a9f791fa-e220-48cc-91d9-0c1ece333658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:44.711405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:44.985932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:44.987650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:45.046888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48c98d-8618-4fd8-90f1-a10b5cdec4aa None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:45.050447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:45.051095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:45.051382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:45.051748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:45.061100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:45.064156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632660-f087-4ec5-aa89-2fc9eb7d01e5 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:45.072718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 779/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:47.341038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:47.341618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:47.341618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:47.342918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 13:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:06:47.348284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097cd0-2363-4303-bb43-9a7c6a332bdb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:47.348724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097cd0-2363-4303-bb43-9a7c6a332bdb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:47.348837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097cd0-2363-4303-bb43-9a7c6a332bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:47.367694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a9097cd0-2363-4303-bb43-9a7c6a332bdb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:06:47.368893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a9097cd0-2363-4303-bb43-9a7c6a332bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:47.376685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:06:47.643572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:06:47.645559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:06:47.658902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bb36-58b2-4011-9e06-8c26b14e4261 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:06:47.662516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:06:47.663141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:06:47.663424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:06:47.663724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:06:47.672378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:06:47.673819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f084-5cea-457d-9d5b-4da9515fba91 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:06:47.683492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 759/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:06:57.361968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=36 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:57.679426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=8 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:17.057612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.058806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.059373 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.097098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.098501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.112806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 781/1540] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:17.121660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.122251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.122251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.151384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.156288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.176385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 760/1541] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.180906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.196300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e393286-d6d4-4ee9-98b0-5be7f2cbc56c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.201222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.201898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.202185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.203067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.204160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:17.204617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.205645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:17.205645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:08:17.205645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:08:17.206526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a8726-aa7e-497c-9a4b-3dbb0cfcff76 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.229664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 782/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:17.237854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.248083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdaa0e-63f1-4ecb-90d2-49cf1f95c832 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.255967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.256657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.256946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.257221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.257942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.258998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:17.258998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:08:17.258998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:08:17.260252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.325024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff66f-a16f-4897-b681-dadd56b37290 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.325369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff66f-a16f-4897-b681-dadd56b37290 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.325601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff66f-a16f-4897-b681-dadd56b37290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.352581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-23cff66f-a16f-4897-b681-dadd56b37290 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.354148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-23cff66f-a16f-4897-b681-dadd56b37290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.365537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 783/1543] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:17.367034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da477e1-a56f-4243-add4-4cdd06c2162a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.367143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da477e1-a56f-4243-add4-4cdd06c2162a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.367389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da477e1-a56f-4243-add4-4cdd06c2162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.373932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 761/1544] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:08:17.379196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.404925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9da477e1-a56f-4243-add4-4cdd06c2162a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.406184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9da477e1-a56f-4243-add4-4cdd06c2162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.500612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8317-7150-4e1c-bbb5-6b0c612b977b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.511360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.512088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.512373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.512650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.513365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.515942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b7d9-e6ee-4505-a1dc-d28397c66ae5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.523222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 784/1545] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.524875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d96b-9b96-4433-91fd-b00e76500b2b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.525170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d96b-9b96-4433-91fd-b00e76500b2b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.525452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d96b-9b96-4433-91fd-b00e76500b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.545266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9059d96b-9b96-4433-91fd-b00e76500b2b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.546571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9059d96b-9b96-4433-91fd-b00e76500b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.555447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 785/1546] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.556755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bbc1c-40b7-4d13-a9e5-91b0d3bba855 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.557045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bbc1c-40b7-4d13-a9e5-91b0d3bba855 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.557326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bbc1c-40b7-4d13-a9e5-91b0d3bba855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.579913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-de2bbc1c-40b7-4d13-a9e5-91b0d3bba855 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.581161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-de2bbc1c-40b7-4d13-a9e5-91b0d3bba855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.589010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 786/1547] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.590220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3912-f877-47f3-9727-42c070f5f65a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.590519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3912-f877-47f3-9727-42c070f5f65a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.590791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc3912-f877-47f3-9727-42c070f5f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.608142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b7cc3912-f877-47f3-9727-42c070f5f65a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.609854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b7cc3912-f877-47f3-9727-42c070f5f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.617516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 787/1548] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.618689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.618978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.619256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.629405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 762/1549] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:08:17.637041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e7cdd-1bde-426d-ba4d-6c83d831f9dd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.637041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e7cdd-1bde-426d-ba4d-6c83d831f9dd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.637041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e7cdd-1bde-426d-ba4d-6c83d831f9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.638083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.639426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.647806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 788/1550] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.648655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.650335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a98e7cdd-1bde-426d-ba4d-6c83d831f9dd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.651766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a98e7cdd-1bde-426d-ba4d-6c83d831f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.658158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec046a84-637b-45b8-8242-6de759a3b07c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.659888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 763/1551] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.661161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f09e-9677-4df7-86d2-13f04a0f4485 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.661453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f09e-9677-4df7-86d2-13f04a0f4485 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.661732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f09e-9677-4df7-86d2-13f04a0f4485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.663072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.663944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.664407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.664863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.665797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:17.666278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.668190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d97a7-0367-4e4a-ac3e-082d0810d8fe admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.680189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4ba1f09e-9677-4df7-86d2-13f04a0f4485 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.680691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 789/1552] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:17.681549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ba1f09e-9677-4df7-86d2-13f04a0f4485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.681953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbda1-7425-4b11-8767-5f17a76890e2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.682251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbda1-7425-4b11-8767-5f17a76890e2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.682537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bbda1-7425-4b11-8767-5f17a76890e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.695407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 764/1553] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.696816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.697113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.697393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.702295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3a0bbda1-7425-4b11-8767-5f17a76890e2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.703820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a0bbda1-7425-4b11-8767-5f17a76890e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.711798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 790/1554] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.713012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.713300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.713697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.714924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.716149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.724992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 765/1555] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.725850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.734906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.735697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1156f9-cbdf-4940-ae4b-c936e349e064 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.736225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.740345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.740994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.741280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.741557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.742277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.743914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ac368-ac9c-4a38-9f09-2287a56194ec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.744045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 791/1556] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.744760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.754742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759737e-3b1d-4e2c-b8b1-5faf79af1e57 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.759145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.759837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.759963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 766/1557] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:17.761076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93673-9f35-412a-a0d0-b176880140e4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.761362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93673-9f35-412a-a0d0-b176880140e4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.761638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93673-9f35-412a-a0d0-b176880140e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.762908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.763198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.763958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:17.764274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.765914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.778433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 792/1558] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:17.779474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5ce93673-9f35-412a-a0d0-b176880140e4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.779747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.781072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ce93673-9f35-412a-a0d0-b176880140e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.789804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48eda-76b2-4625-a607-54fc6dfe5120 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.790223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 767/1559] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.791556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e53-b785-4654-9ba5-a2471714b7e2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.791853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e53-b785-4654-9ba5-a2471714b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.792136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e53-b785-4654-9ba5-a2471714b7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.798264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.799046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.799237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.799520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.800233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.802145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.811446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-42292e53-b785-4654-9ba5-a2471714b7e2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.813365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-42292e53-b785-4654-9ba5-a2471714b7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.821321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 768/1560] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.822684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.822977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.823257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.841009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:17.842216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:17.851029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 769/1561] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:17.851863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.862000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c002d-8f63-4667-95a6-30f8fc4c7f9d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.866507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.867128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.867411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.867785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.868489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:17.868793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.870386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.882315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 770/1562] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:17.883066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.892716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca4ae-69ef-469a-a69a-ff1151fb6ea8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.897255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.902628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.913836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 771/1563] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:17.914539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.926575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6cbe7-1d4a-4efb-acb2-404728418ee8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.931090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:17.931759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:17.932045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:17.932350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:17.933060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:17.934631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:17.936497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 793/1564] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:17.936497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.950355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 772/1565] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:17.950355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:17.958199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957427a1-eb4f-471c-806b-d8fc1e4137b1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:17.988258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:17.990073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:18.004540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fcafa-ac29-4ed7-9cba-c9bcad368ccd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.009503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.010105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.010386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.010660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.011352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.013414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.014588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.015399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.015709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.015990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.016722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:18.017338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.018953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.031471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 773/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:18.032336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.041737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcd2c4-3008-480b-ac35-896d092826bc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.046404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.047046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.047352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.047641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.048355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:18.048661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.050281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.063396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 774/1567] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:18.064452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.073681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a8e3-8022-4f69-88f4-d28808fac056 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.079215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.079878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.080167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.080449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.081157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:18.081467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.083040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.094626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 775/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:18.095518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.104709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44a40e-e5a9-40f5-8072-5af678136817 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.109394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.110016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.110720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.110823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.115083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.117027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.136040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 794/1569] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:17 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.136857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.198636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcea4-d628-471c-b7bf-c22a72c2df89 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.203952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.204615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.204906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.205189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.205875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.207817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.219566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 776/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.219566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.280309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5fe9-220f-46cb-99c6-e5082a877251 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.285066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.285725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.286016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.286294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.286978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.288983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.304852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 795/1571] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.305730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.368279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 777/1572] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.368279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.371170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9d696-49ae-42d4-962d-f44189c0021b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.376408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f495-ebaa-4557-b232-adde7918170c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.376535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.377426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.377718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.378002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] PATH_INFO: `/v3/projects/5b8170a6ef9049519c3c3d344d4b7d52/users/76c21982a1fe49a6afc4083cbfd16916/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.381378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.382055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.382341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.382624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.383308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.385292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.394311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8170a6ef9049519c3c3d344d4b7d52, user_id=76c21982a1fe49a6afc4083cbfd16916, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.397023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.467115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 796/1573] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:18 2022] PUT /identity/v3/projects/5b8170a6ef9049519c3c3d344d4b7d52/users/76c21982a1fe49a6afc4083cbfd16916/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:18.467949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.486921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 778/1574] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.487778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.511382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:18.531851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20978eb-29ef-4760-9e52-1e460a436ce1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.537665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:18.551547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2bc8e-21e4-4360-b5bb-18578ff55a60 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.556248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.556900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.557183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.557458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.558139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.560252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.589298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.589959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.590243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.590519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.591204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.593832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.646526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 779/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.647396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.674756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 797/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.675801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.712462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218730-3d51-4faa-8b11-6d89776abeaa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.738047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524610a7-fc85-4c10-b05d-5676d7a90c8d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.742558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.743219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.743501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.743816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.744495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.745501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:18.745501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:08:18.745501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:08:18.746699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.771209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.771921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.772212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.772492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.773174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.775108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.816802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 798/1577] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.817533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.826966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a97cf3-90ec-474d-85ac-0ea907fa30d8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.832542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.833315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.833609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.833988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.835652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.838457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33724eef-8d6e-43a1-95df-7003eb45067a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.891221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 780/1578] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.892616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.902186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adf369-6557-4a6c-844e-365948ae7c2e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.906836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.907485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.907794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.908069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.908786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.910364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.919424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 799/1579] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:18.920836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.921207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.922763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 781/1580] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:18.922894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.923003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:18.935351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f0f3-9730-4d78-932a-8b22fe107ca0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:18.940870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:18.941620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:18.941917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:18.942200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:18.942888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:18.944945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:18.950027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] MFA Rules not processed for user `76c21982a1fe49a6afc4083cbfd16916`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:18.951352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:18.985053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:19.017432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 800/1581] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:19.018382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.029352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be33501-5f99-4c3e-a354-efaa42b66ce9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.034492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.035188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.035473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.035845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.036570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.038594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.040525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 782/1582] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:18 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:19.040525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.050641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d02ef-7295-404e-ab2a-6df9520a8818 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.055290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.055990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.056284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.056559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.057241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.059155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.147783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 801/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:19 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:19.148615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.158868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70471d-cf87-436b-88c9-e6ee8da9aae0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.163279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 783/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:19 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:19.163279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.164068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.164763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.165052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.165330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.166054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.167676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.171913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c06f5-f13d-4106-bee9-53ad0b1c0ae9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.177010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.177698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.177976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.178255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.178719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 802/1585] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.178984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.179799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.180715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.190200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3336e1-1f18-4794-bfed-59ea6c708e5f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.194573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 784/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.194573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.195074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.195896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.196206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.196731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.197586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.199802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.206499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8bce-e24b-45f2-a6fa-ef68e509ebce admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.206904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.207569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.207866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.208142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.208863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.210419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.211281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 803/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.212214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.216330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:19.221659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 785/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.222570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.232284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db41b7-c0e6-48bf-8c77-cf14c5cc4fcb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.237884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.238629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.239008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.239353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.240089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.241712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.253642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 786/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.255200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.265417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57937098-76d8-4dd1-8f42-8ad3f1321d48 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.270349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.271007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.271295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.271598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.272318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.273903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.278348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dafd0-7c21-41b7-b13d-637cfc11307c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.282039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.282683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.282972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.283252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.284691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 787/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.285518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.295713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.297796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79474d7-415a-4c6d-a729-f6aa2f265ffa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.298306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.302691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.303331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.303645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.303923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.304630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.306192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.307648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 804/1591] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:19.308451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.317401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 788/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.320472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.323335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4ad10-af89-479e-87a2-21023f0e4a6f service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.328295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705b96-d4e6-477d-999a-b58830c2b8ea admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.328984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.329852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.330148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.330430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.331162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.332795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.333066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.333716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.334131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.334314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.334985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.336580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.344808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 805/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.345865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.347345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 789/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.350442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.357368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b8bcf-f449-4451-869e-1be5c7effa0a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.357984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836b35-2d08-4375-9cc3-f805a61c88ce admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.363092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.363626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.363790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.364032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.364306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.365047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.365314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.365761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.366202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] PATH_INFO: `/v3/projects/d2263cfc378b4967ab4d2817991874f5/users/e8410e3632ec4908824d336fff667da5/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.366619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.379140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 790/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.383025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.383906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2263cfc378b4967ab4d2817991874f5, user_id=e8410e3632ec4908824d336fff667da5, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.386746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.393119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282e5a4-a213-4c7b-bf8d-268d4e1a5b51 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.401892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.401892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.401892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.401892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.402341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.402341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.412354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 791/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.413155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.423334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9332f-1343-4b2c-9b22-647b2bf0f245 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.427926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.428605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.428895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.429175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.429998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.431607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.442876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 792/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.443747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.453325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f2d4a-a6cd-4d43-bad3-ceffa5865173 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.458377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.459031 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.459321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.459692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.464346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.464346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.472710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 793/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:19.472710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.483011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d55d6-62e6-4610-b757-c58ce1750a4a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.492765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.493666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.493957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.494280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] PATH_INFO: `/v3/projects/9e72dd6caaa243f9ac9989f766976e30/users/6c12284a3fb845a5b6c073fcb98913ee/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.495728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 806/1599] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/d2263cfc378b4967ab4d2817991874f5/users/e8410e3632ec4908824d336fff667da5/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:19.496745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.513287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e72dd6caaa243f9ac9989f766976e30, user_id=6c12284a3fb845a5b6c073fcb98913ee, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.516112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:19.516112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:08:19.516112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:08:19.518137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.563684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fdafe-1dbb-4fbb-a4ac-461bc27719a7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.568375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.569270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.569559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.569836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] PATH_INFO: `/v3/projects/b6c8686c006d4c31966ec3d477dbfd20/users/8fc62a97460647269febeaa1df22e4bc/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.572952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:19.584928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c8686c006d4c31966ec3d477dbfd20, user_id=8fc62a97460647269febeaa1df22e4bc, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.587655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.593668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 794/1600] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/9e72dd6caaa243f9ac9989f766976e30/users/6c12284a3fb845a5b6c073fcb98913ee/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:19.594463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.651991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 807/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/b6c8686c006d4c31966ec3d477dbfd20/users/8fc62a97460647269febeaa1df22e4bc/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:19.652748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.659089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e0e3-059e-41b2-9d81-5720d566a3f6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.713016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:19.720485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.721384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.721670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.721942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] PATH_INFO: `/v3/projects/3f88c159807e4712a1210b9f50d753b5/users/78e8890d5c6e4be2994b9bb97d6b5228/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.727499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e59faa-ddf4-420a-8fc7-52a1e18ab38d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.733247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.734554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.735084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.735443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] PATH_INFO: `/v3/projects/d6db503a0a1749789e92ed63f5a113b7/users/9c620175b84d4cee9aef398864c03c8d/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.736832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f88c159807e4712a1210b9f50d753b5, user_id=78e8890d5c6e4be2994b9bb97d6b5228, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.739678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.753330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6db503a0a1749789e92ed63f5a113b7, user_id=9c620175b84d4cee9aef398864c03c8d, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.756292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.845521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 795/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/3f88c159807e4712a1210b9f50d753b5/users/78e8890d5c6e4be2994b9bb97d6b5228/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:19.846498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.859835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 808/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/d6db503a0a1749789e92ed63f5a113b7/users/9c620175b84d4cee9aef398864c03c8d/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:19.860862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:19.919683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d355bc-37a6-49e1-8196-87e470128d19 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.930880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed77a2-7d32-488e-afdb-6c5290f7bbcd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:19.935850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.937369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.937747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.938064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] PATH_INFO: `/v3/projects/2b88389a00a342e285e0c31b90368f87/users/288ab671062d409f98b91aeacde8b5fc/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:19.955046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b88389a00a342e285e0c31b90368f87, user_id=288ab671062d409f98b91aeacde8b5fc, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:19.957799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb39cf3-73a9-48b7-a60f-23e2abf1f6fa admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:19.984787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:19.985671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:19.985958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:19.986238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] PATH_INFO: `/v3/projects/217a93e9314e4b06ae49a36a9969e22e/users/15aec8f2f71e4084a21cc0cfc3a52bd2/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.000591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217a93e9314e4b06ae49a36a9969e22e, user_id=15aec8f2f71e4084a21cc0cfc3a52bd2, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.003249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b5bb-15f4-42f1-9305-3317096d5406 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.042333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 809/1604] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/2b88389a00a342e285e0c31b90368f87/users/288ab671062d409f98b91aeacde8b5fc/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:20.043645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b14aa-a168-4675-9f4b-a04c77ba0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.043940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b14aa-a168-4675-9f4b-a04c77ba0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.044263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b14aa-a168-4675-9f4b-a04c77ba0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.062449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-747b14aa-a168-4675-9f4b-a04c77ba0ad3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.063724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-747b14aa-a168-4675-9f4b-a04c77ba0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.106246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.117019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 796/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:19 2022] PUT /identity/v3/projects/217a93e9314e4b06ae49a36a9969e22e/users/15aec8f2f71e4084a21cc0cfc3a52bd2/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:20.118392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42890-7ef1-4b4f-860f-fca45dcbf3f9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.118688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42890-7ef1-4b4f-860f-fca45dcbf3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.118966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42890-7ef1-4b4f-860f-fca45dcbf3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.121645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 810/1606] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.122893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536897d-3816-4352-81a9-8d9ba75d1c56 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.123184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536897d-3816-4352-81a9-8d9ba75d1c56 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.123464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536897d-3816-4352-81a9-8d9ba75d1c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.138420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8db42890-7ef1-4b4f-860f-fca45dcbf3f9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.139657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8db42890-7ef1-4b4f-860f-fca45dcbf3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.153648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5536897d-3816-4352-81a9-8d9ba75d1c56 None None] MFA Rules not processed for user `8fc62a97460647269febeaa1df22e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.154877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5536897d-3816-4352-81a9-8d9ba75d1c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.211000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 797/1607] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.212839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.213238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.213626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.232766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.243491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] MFA Rules not processed for user `78e8890d5c6e4be2994b9bb97d6b5228`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.244731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.255693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 811/1608] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.257260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653ce8-9eeb-46b7-8f0e-7f933ec25bb2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.257563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653ce8-9eeb-46b7-8f0e-7f933ec25bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.257848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653ce8-9eeb-46b7-8f0e-7f933ec25bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.279587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5e653ce8-9eeb-46b7-8f0e-7f933ec25bb2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.282206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5e653ce8-9eeb-46b7-8f0e-7f933ec25bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.291346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 812/1609] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.293515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174960-3f50-4961-90eb-3c28c86e3725 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.293948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174960-3f50-4961-90eb-3c28c86e3725 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.294403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e174960-3f50-4961-90eb-3c28c86e3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.318146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3e174960-3f50-4961-90eb-3c28c86e3725 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.327605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3e174960-3f50-4961-90eb-3c28c86e3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.338847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 813/1610] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.340754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 798/1611] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.341723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.342022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.342445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.342663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.346287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.364282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.368746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.374717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 814/1612] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.376079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.380923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.419155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf464-76fa-436c-8923-700b532ead7e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.423553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.424267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.424553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.424865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.435921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.437486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.447899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 799/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.451855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.451970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf336f-f5b0-4b55-b22e-a97b76bd3001 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.455269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.455958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.456248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.456532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.458246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4413785-bc5d-4d44-be99-3c729d63df60 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.461925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.462885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.462885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.463133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.466463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.468826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902bfc-0899-4f36-80f3-ddff38ede6f2 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.473610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.475242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.479477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 815/1614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.480916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a20a-bd78-49e7-a989-2ac02bd63cea None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.481368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a20a-bd78-49e7-a989-2ac02bd63cea None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.481622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a20a-bd78-49e7-a989-2ac02bd63cea None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.483125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 816/1615] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 6 13:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:20.483848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a20a-bd78-49e7-a989-2ac02bd63cea None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.488275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 800/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.489237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.497036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a20a-bd78-49e7-a989-2ac02bd63cea None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.498877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755037-1dc3-469e-9c33-bb1c958da2e3 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.502682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.503299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.503439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.503877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.515023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.515183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.515316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.515316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.515488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.515488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.517399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.518943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.529513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 801/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.530938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.549397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6cf2-47e7-40d5-a42b-33b4aa84e0e8 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.550503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.551149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.551432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.551750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.561633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.563176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a681cc-cd0e-4a5f-8d70-e4983c86a8e3 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.574016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 802/1618] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.575289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.575610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.575891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.594352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:20.595618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:20.647243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 817/1619] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:20.647243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.656754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.675812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 803/1620] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:20.688145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.697734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.703155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577c498-78fc-4e50-ab83-59a4c3011a7f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.745821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24485e-b55c-46f0-b97e-56ab77c95438 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.745821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.745821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.745821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.746492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.746492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.746492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.772753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.773409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.773696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.773979 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.833291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.834891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.844968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 804/1621] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:20.848346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 818/1622] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:20 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:20.852668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.864700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f12d-d4e2-4b45-a089-1b98726ee26f service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.871195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.871948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.872238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.872571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.873296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.875423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:20.886552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 805/1623] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:20.891153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:20.902707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac752-ae14-4641-8e37-5ab02a755e5e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:20.908411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:20.909548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:20.910048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:20.910493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] PATH_INFO: `/v3/projects/107600e9bc8c4ddd81fab3efa625076c/users/b2900e2a8f8f45208015b21cd695a038/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:20.931635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=107600e9bc8c4ddd81fab3efa625076c, user_id=b2900e2a8f8f45208015b21cd695a038, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:20.934659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2e56-d54a-4ece-bc6a-953506ed3bde admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:21.011704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 819/1624] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:20 2022] PUT /identity/v3/projects/107600e9bc8c4ddd81fab3efa625076c/users/b2900e2a8f8f45208015b21cd695a038/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:21.017106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:21.028624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74913a9e-304e-4d3a-900f-3c92326fd289 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:21.095831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:21.096194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac366f-c035-435f-8b6c-e273cb7c9bf9 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.096487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac366f-c035-435f-8b6c-e273cb7c9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.096599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.096770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac366f-c035-435f-8b6c-e273cb7c9bf9 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.096888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.097072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.097859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:21.098186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 820/1625] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 6 13:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:21.099475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:21.107560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.108446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.108446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.125413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 806/1626] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:21.127232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:21.132181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:21.133497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:21.140633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bb5cf-e044-417e-aad3-55607a8b5339 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:21.149123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:21.151143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.151560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.152199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] PATH_INFO: `/v3/projects/107600e9bc8c4ddd81fab3efa625076c/users/b2900e2a8f8f45208015b21cd695a038/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.154314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107600e9bc8c4ddd81fab3efa625076c, user_id=b2900e2a8f8f45208015b21cd695a038, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:21.157795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404fab6-1ba2-41fd-900d-241d9c4f9066 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:21.170381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 807/1627] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:21 2022] PUT /identity/v3/projects/107600e9bc8c4ddd81fab3efa625076c/users/b2900e2a8f8f45208015b21cd695a038/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:08:21.180558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.181174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.181174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.187602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.212582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] MFA Rules not processed for user `b2900e2a8f8f45208015b21cd695a038`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:21.214081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:21.215671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 821/1628] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:21.229025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:21.297320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01aab2-d936-4cd8-99c2-fd3e0a82ccdf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:21.300671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 808/1629] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:21.314797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:21.355602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:21.356273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.356561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.356843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.373015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325b058-7dd8-4a77-98a1-590bb6ed4688 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:21.378256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:21.379011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.379371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.379710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.392484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:21.394599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc747-77a2-4488-a831-d7dabdcf651a service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:21.407299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 809/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:21.436380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:21.438173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48993a-4e5a-4858-99f2-cda1ba97a700 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:21.450441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 822/1631] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:21.594350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.897217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5f2b-646d-4cfa-ad39-2bcb85991290 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.897963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5f2b-646d-4cfa-ad39-2bcb85991290 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.898996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5f2b-646d-4cfa-ad39-2bcb85991290 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.909269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 810/1632] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 6 13:08:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:21.919988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d15-6db6-4616-8f53-4615b462e928 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.920612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d15-6db6-4616-8f53-4615b462e928 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.922402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d15-6db6-4616-8f53-4615b462e928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.957321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1a098d15-6db6-4616-8f53-4615b462e928 None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:21.958596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1a098d15-6db6-4616-8f53-4615b462e928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:21.988219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 823/1633] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 6 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:21.993106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a79fe-3b05-42d8-88b1-8fe94933aa41 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:21.993397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a79fe-3b05-42d8-88b1-8fe94933aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:21.993677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a79fe-3b05-42d8-88b1-8fe94933aa41 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:21.995302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 811/1634] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 6 13:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:22.002000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:22.002290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:22.002570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:22.025843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:22.025843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:22.043024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 824/1635] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:22.186246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a79fe-3b05-42d8-88b1-8fe94933aa41 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:22.198239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a79fe-3b05-42d8-88b1-8fe94933aa41 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:22.202931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:22.203825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:22.204295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:22.204574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:22.216938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:22.219076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9f479-9f81-4bfc-8c1a-ad674b2ed61d service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:22.231003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 812/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:23.053478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:23.137570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f71-e91b-4cf2-b662-f47f58357f46 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:23.138081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f71-e91b-4cf2-b662-f47f58357f46 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:23.138201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f71-e91b-4cf2-b662-f47f58357f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:23.157100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7980b-b37b-4da4-b618-566777f1528b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:23.172727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:23.175109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:23.176508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:23.176793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] PATH_INFO: `/v3/users/78e8890d5c6e4be2994b9bb97d6b5228` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:23.178781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e8890d5c6e4be2994b9bb97d6b5228)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:23.182488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:23.197731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7f615f71-e91b-4cf2-b662-f47f58357f46 None None] MFA Rules not processed for user `6c12284a3fb845a5b6c073fcb98913ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:23.197731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7f615f71-e91b-4cf2-b662-f47f58357f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 813/1637] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:23.539606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] MFA Rules not processed for user `6c12284a3fb845a5b6c073fcb98913ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:23.545134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:23.545134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 814/1638] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:23.545134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:23.545134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b1ee9-8d27-431c-81df-8e27904afde7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:23.548503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:23.548503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:23.548503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:23.548503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:23.550805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:23.550805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a482a-456e-4307-9edf-201c81555da5 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:23.550805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 815/1639] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:23.675996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e8890d5c6e4be2994b9bb97d6b5228'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:23.676949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e8890d5c6e4be2994b9bb97d6b5228'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:23.769776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e8890d5c6e4be2994b9bb97d6b5228'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:23.796735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e8890d5c6e4be2994b9bb97d6b5228'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:23.814076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e8890d5c6e4be2994b9bb97d6b5228'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:23.831351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 825/1640] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:23 2022] DELETE /identity/v3/users/78e8890d5c6e4be2994b9bb97d6b5228 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:08:23.837396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc010-a57c-490e-9dd2-92d46073b402 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:23.837713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc010-a57c-490e-9dd2-92d46073b402 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:23.837997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fc010-a57c-490e-9dd2-92d46073b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:23.871781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1c2fc010-a57c-490e-9dd2-92d46073b402 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:23.875420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c2fc010-a57c-490e-9dd2-92d46073b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:24.021230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 816/1641] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:24.053725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:24.056777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:24.065947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:24.166756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a1c3b-242d-404d-95f8-5d8c36b25099 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:24.177504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:24.178442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:24.178864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:24.179281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:24.201413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:24.203729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82991327-92cf-4882-8204-2c08214a9b28 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:24.224404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 826/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:24.331243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454ab5-dd7b-468f-baed-a7ecf9a09d4a None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:24.332824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454ab5-dd7b-468f-baed-a7ecf9a09d4a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:24.333264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454ab5-dd7b-468f-baed-a7ecf9a09d4a None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:24.336344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 817/1643] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 6 13:08:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:24.345667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:24.346187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:24.346602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:24.415030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:24.416333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:24.437841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 827/1644] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:24.475368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8454ab5-dd7b-468f-baed-a7ecf9a09d4a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:24.497772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8454ab5-dd7b-468f-baed-a7ecf9a09d4a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:24.503023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:24.503586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:24.503947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:24.505139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:24.520663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:24.522270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bba046-ed5f-40c0-ba56-cf0887d426d0 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:24.546684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 818/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:25.712645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:25.719562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:25.749399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ee55-27a1-48c2-8290-a0865ba6dbd0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:25.758833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:25.760166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:25.760664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:25.761155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] PATH_INFO: `/v3/projects/3f88c159807e4712a1210b9f50d753b5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:25.762715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f88c159807e4712a1210b9f50d753b5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:25.764046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: WARNING py.warnings [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:25.764046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: warnings.warn(msg) Jun 06 13:08:25.764046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: Jun 06 13:08:25.767904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:25.830179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d16cf-d1bd-42f4-9a13-d14e9f0954ea None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:25.833311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d16cf-d1bd-42f4-9a13-d14e9f0954ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:25.833311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d16cf-d1bd-42f4-9a13-d14e9f0954ea None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:25.833311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 819/1646] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jun 6 13:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:25.838934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:25.839599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:25.840076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:25.862300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:25.864212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:25.960438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 820/1647] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jun 6 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:25.961812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:25.975753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0ea37-0a66-4b2f-9bd7-ec0d3b69dd1b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:26.012233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f88c159807e4712a1210b9f50d753b5', 'request_id': 'req-8cc2ccec-2870-4de9-bd12-17136bea0e2b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.111904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f88c159807e4712a1210b9f50d753b5', 'request_id': 'req-8cc2ccec-2870-4de9-bd12-17136bea0e2b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.122769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f88c159807e4712a1210b9f50d753b5', 'request_id': 'req-8cc2ccec-2870-4de9-bd12-17136bea0e2b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.136222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:26.137110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:26.137568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:26.137953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:26.141873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:26.159203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:26.162023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:26.177670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:26.177853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] The token cache is being invalidate because project 3f88c159807e4712a1210b9f50d753b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:26.177853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.180011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.192158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 828/1648] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:25 2022] DELETE /identity/v3/projects/3f88c159807e4712a1210b9f50d753b5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:26.199764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:26.203260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 821/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:26.207570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:26.382036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ccec-2870-4de9-bd12-17136bea0e2b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:26.392695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:26.397162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:26.397162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:26.397162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] PATH_INFO: `/v3/users/b2900e2a8f8f45208015b21cd695a038` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:26.399025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2900e2a8f8f45208015b21cd695a038)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:26.401660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:26.418910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:26.637150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2900e2a8f8f45208015b21cd695a038'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.640080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2900e2a8f8f45208015b21cd695a038'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.758633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2900e2a8f8f45208015b21cd695a038'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.785393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2900e2a8f8f45208015b21cd695a038'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.816613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e1789943-4481-4d8f-ae13-1922b276cee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2900e2a8f8f45208015b21cd695a038'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:26.850848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 829/1650] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:26 2022] DELETE /identity/v3/users/b2900e2a8f8f45208015b21cd695a038 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:29.138882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:29.181211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f04fe-105e-4273-9524-3c93fd7bdba2 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:29.399791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:29.400708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:29.400994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:29.401270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] PATH_INFO: `/v3/projects/107600e9bc8c4ddd81fab3efa625076c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:29.410036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107600e9bc8c4ddd81fab3efa625076c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:29.412123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:29.681376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107600e9bc8c4ddd81fab3efa625076c', 'request_id': 'req-37e1fcf8-835f-4327-a3a7-48b566da7c39'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:29.697947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107600e9bc8c4ddd81fab3efa625076c', 'request_id': 'req-37e1fcf8-835f-4327-a3a7-48b566da7c39'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:29.865199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107600e9bc8c4ddd81fab3efa625076c', 'request_id': 'req-37e1fcf8-835f-4327-a3a7-48b566da7c39'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:29.881251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] The token cache is being invalidate because project 107600e9bc8c4ddd81fab3efa625076c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:29.882179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:29.889477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-37e1fcf8-835f-4327-a3a7-48b566da7c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:29.892515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 822/1651] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:29 2022] DELETE /identity/v3/projects/107600e9bc8c4ddd81fab3efa625076c => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:29.897744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:29.898249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:29.898322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:29.938403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:29.939976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:30.045771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 830/1652] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:30.053510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:30.053910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:30.054269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:30.093648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:30.095254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:30.121295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 823/1653] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:30.126044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:30.141214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7c8f-6c57-4a88-a746-65b392db7e77 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:30.163740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:30.164671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:30.165101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:30.165546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:30.166431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:30.167223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:30.169251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:30.220942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 831/1654] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:30.222111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:30.239736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecbf87-346d-4cf0-90d7-dc7d28977f4b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:30.261380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:30.262155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:30.263044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:30.263397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:30.264333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:30.272387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:30.416784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:30.430485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 824/1655] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:30 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:30.435993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1800f76-d92b-4501-9abe-91a76a6451a7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:30.751555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:30.752300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:30.752599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:30.760037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:30.770655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:30.772827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:30.879113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 832/1656] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:30 2022] POST /identity/v3/users => generated 305 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:30.880970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:30.900728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25ad0a-364a-40a0-b774-b419c27b558e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:30.931936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:30.932631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:30.932923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:30.936879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:30.936879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:30.936879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:30.975440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 825/1657] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:30.979234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:30.988724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:31.001390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4522c-abfa-4a8f-9246-c6b4e40ede46 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:31.017722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:31.018428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.018911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.019196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.021237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:31.034941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112cfe-b69b-4e34-8ec8-7c092c0ddeb1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:31.081056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 833/1658] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:31.083653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:31.105693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f560a1-634a-4def-bdbf-b8026fb81c9e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:31.134637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:31.135866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.136228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.136644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] PATH_INFO: `/v3/projects/eac8416ab31041d694991d2e5f853530/users/b40cc5adbd25485aa2059b421e15b289/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.169313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac8416ab31041d694991d2e5f853530, user_id=b40cc5adbd25485aa2059b421e15b289, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:31.173142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41248-8a29-45f7-89cc-ea00531e5664 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:31.304848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 826/1659] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:31 2022] PUT /identity/v3/projects/eac8416ab31041d694991d2e5f853530/users/b40cc5adbd25485aa2059b421e15b289/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:31.317783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.318079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.318429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.331568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.331568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.331568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.393424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:31.394706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:31.443933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] MFA Rules not processed for user `b40cc5adbd25485aa2059b421e15b289`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:31.445431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:31.487418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:31.576129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 827/1660] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:31.578131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:31.581629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:31.688241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 834/1661] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:31.692744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:31.775460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38385ef-cbf1-4edb-bcfd-56736ab91c5f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:31.802058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:31.802938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.803149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.803375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] PATH_INFO: `/v3/users/8fc62a97460647269febeaa1df22e4bc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.807362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc62a97460647269febeaa1df22e4bc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:31.808440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: WARNING py.warnings [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:08:31.808440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: warnings.warn(msg) Jun 06 13:08:31.808440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: Jun 06 13:08:31.809917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:31.891169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2d438-a27c-4daf-b2d5-cdcce69fd1c9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:31.911957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:31.912651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:31.912941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:31.913236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:31.924441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:31.939168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:32.131832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 835/1662] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:31 2022] POST /identity/v3/projects => generated 409 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:32.132833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:32.143772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:32.181016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc62a97460647269febeaa1df22e4bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:32.181792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc62a97460647269febeaa1df22e4bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:32.210849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc62a97460647269febeaa1df22e4bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:32.277514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc62a97460647269febeaa1df22e4bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:32.344113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3dc9-e2e8-48e8-8287-86031b2e238b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:32.353148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc62a97460647269febeaa1df22e4bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:32.360666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:32.361685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.361685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.361860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:32.362008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 828/1663] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:31 2022] DELETE /identity/v3/users/8fc62a97460647269febeaa1df22e4bc => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:32.363107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:32.364445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:32.365303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:32.508712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb18-d8df-43f7-b356-4943eb01b754 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:32.515164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:32.517157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:32.518124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.518620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.518752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd979e2f-d265-47fe-b815-2f57df8322d1 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:32.519173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:32.520124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:32.525731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:32.547788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 836/1664] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:08:32.553018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.553379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.555847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:32.611903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:32.613656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:32.627706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 837/1665] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:32.682669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 829/1666] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:32 2022] POST /identity/v3/users => generated 311 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:32.687262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:32.688511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:32.690028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:32.700835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa36e57-eab9-45a6-9a76-d352e41993e4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:32.728888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:32.729581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.729866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.733530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:32.733530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:32.736093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:32.781406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 838/1667] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:32.782383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:32.804857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a01404-e272-4762-9f6c-405c025dd909 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:32.840460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:32.844431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.844431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.844431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] PATH_INFO: `/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4/users/3e9b360d18224f8d9b0dd9888630ef98/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:32.897021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1deee1fe48476b8fc6fed1e9262cf4, user_id=3e9b360d18224f8d9b0dd9888630ef98, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:32.900657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:32.960198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc103-2328-49d2-8cc4-19717a5a7dea admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:32.982164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:32.983722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:32.983826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:32.984148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:33.030161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 839/1668] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:32 2022] PUT /identity/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4/users/3e9b360d18224f8d9b0dd9888630ef98/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:33.033604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:33.034362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:33.041116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:33.093939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 830/1669] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:33.158457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:33.225333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e87ec6-0b62-4cac-b804-feca7d9fa549 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:33.246304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:33.247058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:33.250146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:33.250436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:33.251265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:33.259512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f326-81f7-4f15-9f88-ab90b7778158 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:33.290905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 840/1670] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:33.294764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:33.316728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc91222-8bcf-4440-9279-009991667361 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:33.327415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:33.328372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:33.329437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:33.332384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] PATH_INFO: `/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4/users/3e9b360d18224f8d9b0dd9888630ef98/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:33.342531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1deee1fe48476b8fc6fed1e9262cf4, user_id=3e9b360d18224f8d9b0dd9888630ef98, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:33.345988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:33.401776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 831/1671] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:33 2022] PUT /identity/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4/users/3e9b360d18224f8d9b0dd9888630ef98/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:08:33.417167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:33.417482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:33.417751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:33.505088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] MFA Rules not processed for user `3e9b360d18224f8d9b0dd9888630ef98`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:33.507936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:33.563679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:33.749543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 841/1672] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:33.761552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:33.765648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:33.910952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ace6-7703-4df7-9d98-25ffccf6e73a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:33.916020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:33.916693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:33.917225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:33.917452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:33.934899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:33.938161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:33.969888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 832/1673] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:34.605117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:34.612129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:34.661957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba0e7-dc87-412b-a7c8-4aff0a812d0a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:34.695885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:34.696618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:34.697769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:34.697769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:34.699471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:34.802214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:34.808757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:34.814407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 842/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:34.865214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:35.529535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:35.535908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:35.671562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:35.683986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:35.708150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709611ea-e6b0-499c-ad8c-76ceacb4f369 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:35.709833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a873a4-c67f-474b-8991-2c36aed00a54 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:35.720092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:35.720980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:35.721599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:35.721870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:35.722193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:35.722478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] PATH_INFO: `/v3/projects/b6c8686c006d4c31966ec3d477dbfd20` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:35.722851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:35.723330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] PATH_INFO: `/v3/users/76c21982a1fe49a6afc4083cbfd16916` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:35.725165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c8686c006d4c31966ec3d477dbfd20)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:35.726467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c21982a1fe49a6afc4083cbfd16916)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:35.727149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:35.730962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:35.786391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:35.945736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c8686c006d4c31966ec3d477dbfd20', 'request_id': 'req-0e263c59-5946-485f-9883-7b4096af8823'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.019803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c21982a1fe49a6afc4083cbfd16916'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.020737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c21982a1fe49a6afc4083cbfd16916'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.043178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c8686c006d4c31966ec3d477dbfd20', 'request_id': 'req-0e263c59-5946-485f-9883-7b4096af8823'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.044871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c21982a1fe49a6afc4083cbfd16916'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.055067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c8686c006d4c31966ec3d477dbfd20', 'request_id': 'req-0e263c59-5946-485f-9883-7b4096af8823'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.091317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c21982a1fe49a6afc4083cbfd16916'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.106481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] The token cache is being invalidate because project b6c8686c006d4c31966ec3d477dbfd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:36.108228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.110224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0e263c59-5946-485f-9883-7b4096af8823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.112831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 843/1675] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:35 2022] DELETE /identity/v3/projects/b6c8686c006d4c31966ec3d477dbfd20 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:36.114711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478d8d5-a52e-476e-8405-9abd2d8a525f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.115221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478d8d5-a52e-476e-8405-9abd2d8a525f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.115845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478d8d5-a52e-476e-8405-9abd2d8a525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.152785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f478d8d5-a52e-476e-8405-9abd2d8a525f None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:36.155009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f478d8d5-a52e-476e-8405-9abd2d8a525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:36.205782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ee5eb71c-e08a-4f91-9c52-3daa927c000b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c21982a1fe49a6afc4083cbfd16916'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:36.242625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 833/1676] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:35 2022] DELETE /identity/v3/users/76c21982a1fe49a6afc4083cbfd16916 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:36.243129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cc1-14be-4fc4-a816-0bfef68299b7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.243670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cc1-14be-4fc4-a816-0bfef68299b7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.251607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cc1-14be-4fc4-a816-0bfef68299b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.306997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 844/1677] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Jun 6 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:36.308494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.308675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.309439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.336743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cd0b5cc1-14be-4fc4-a816-0bfef68299b7 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:36.338023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cd0b5cc1-14be-4fc4-a816-0bfef68299b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:36.371647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:36.382685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:36.415348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:36.487601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 834/1678] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:36.495494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.496185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.496678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.551293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:36.554900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:36.577848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 835/1679] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:36.580103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:36.626380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643a24a-bb93-43d7-8185-90c88bb411e6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:36.652189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:36.652189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.652189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.652189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.652709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:36.652709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:36.655588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:36.672934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 836/1680] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:36.677607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:36.693486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 845/1681] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:36.715929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37664e-91a6-488d-ae61-28079db1af9b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:36.728245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:36.728936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:36.729249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:36.730910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:36.732686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:36.736967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:36.758410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:36.760231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:36.915089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 837/1682] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:36 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:36.925325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:36.931917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:37.057695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854323-9aa5-44da-97f9-c63bac5e75c1 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.225145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732d7d-05ea-49cb-b161-b0e4beaa5c21 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.233893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.252830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.258118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.258564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.281095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.284335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:37.286054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.286849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.289127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.289537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.314183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 838/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:37.315978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:37.520906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.522375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:37.534803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 846/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:37.544121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb52b35-0746-4323-b450-c395de1b8119 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.564613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.566528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.566823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.569299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.581177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.581177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:37.679162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 839/1685] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:37 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:37.683475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:37.715489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9438cb-f8fd-4109-971f-2b544af0644c service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.735342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.739224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.739914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.740427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.741398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.744839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:37.752401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:37.787399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:37.788032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 847/1686] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:37.813099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21300-daeb-4670-8418-32f533492271 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.827642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.829503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.829801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.830083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.831648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.838028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8211-43d3-43df-a0b5-52192a55e72e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:37.867093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 840/1687] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:37.870184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:37.891870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725f0d-3cc3-4957-85b6-2d4d226c0f69 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:37.932113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:37.933053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:37.933340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:37.933620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] PATH_INFO: `/v3/projects/14d3e44f18bb40f5a0cf56a8db73a90e/users/0a387c6a414c45f68fd92e3db9cd1e3e/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:37.983175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3e44f18bb40f5a0cf56a8db73a90e, user_id=0a387c6a414c45f68fd92e3db9cd1e3e, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:37.986098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:38.108716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 848/1688] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:37 2022] PUT /identity/v3/projects/14d3e44f18bb40f5a0cf56a8db73a90e/users/0a387c6a414c45f68fd92e3db9cd1e3e/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:38.113168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:38.113520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:38.113802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:38.137453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:38.181704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] MFA Rules not processed for user `0a387c6a414c45f68fd92e3db9cd1e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:38.184881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:38.402238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 841/1689] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:38.407512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:38.569186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b799fe-e3e0-4096-a2a0-3e83d5657ecc admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:38.574818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:38.577004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:38.577292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:38.577704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:38.578428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:38.580607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:38.699270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 849/1690] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:38 2022] POST /identity/v3/projects => generated 373 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:38.707703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:38.730974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443c31-38b5-463d-a18f-a5291650cfa5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:38.899598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:38.900411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:38.900761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:38.911044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:38.911972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:38.923768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:39.098575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 842/1691] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:38 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:39.098755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:39.122188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbec17-d620-42a2-a118-0ffb220e70ad admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:39.143378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:39.144112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.144958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.144958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:39.148549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:39.150328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3b3d6-c50f-4a81-97d3-36974e6c7437 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:39.187589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 850/1692] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:39.188104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:39.203957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.204673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.205139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:39.220834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7df4c-162d-4bcd-8b84-e10988874254 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:39.236382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:39.237427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.237817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.238198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] PATH_INFO: `/v3/projects/84eb3d2cfb84485090ae562025f6b555/users/1ae02ee3dbce4dd187bc488b2179cfd3/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:39.270836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] MFA Rules not processed for user `9c620175b84d4cee9aef398864c03c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:39.288860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:39.298273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eb3d2cfb84485090ae562025f6b555, user_id=1ae02ee3dbce4dd187bc488b2179cfd3, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:39.308156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:39.310841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:39.442339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 843/1693] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:39 2022] PUT /identity/v3/projects/84eb3d2cfb84485090ae562025f6b555/users/1ae02ee3dbce4dd187bc488b2179cfd3/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:39.446288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:39.525775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 851/1694] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:39.536945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:39.538776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:39.656444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696efb-af08-4491-8844-69d319d34680 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:39.666278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:39.682415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:39.683115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.683405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.683728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:39.697013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:39.698713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:39.701574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde60e-a9fc-43f9-a266-7ea61f08d886 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:39.745008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 844/1695] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:08:39.746338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:39.760545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:39.787552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b353c-8173-4466-abf5-a23d3c46b9ab admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:39.829442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:39.836493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.836493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.836914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] PATH_INFO: `/v3/projects/5b8170a6ef9049519c3c3d344d4b7d52` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:39.839887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8170a6ef9049519c3c3d344d4b7d52)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:39.844760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:39.861996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:39.862672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:39.863451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:39.863929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.004927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:40.004927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:40.004927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 852/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:40.004927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:40.079962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b0c3-6f18-4e0c-9f00-286a6bd1b201 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:40.095438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:40.097030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:40.097407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:40.097769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] PATH_INFO: `/v3/projects/84eb3d2cfb84485090ae562025f6b555/users/1ae02ee3dbce4dd187bc488b2179cfd3/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.101866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eb3d2cfb84485090ae562025f6b555, user_id=1ae02ee3dbce4dd187bc488b2179cfd3, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:40.118915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64ed40-23a8-44b8-82d1-7723adf10756 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:40.164321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8170a6ef9049519c3c3d344d4b7d52', 'request_id': 'req-32a697be-d0ab-4488-84e4-2dd7211a260b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:40.184786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 853/1697] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:40 2022] PUT /identity/v3/projects/84eb3d2cfb84485090ae562025f6b555/users/1ae02ee3dbce4dd187bc488b2179cfd3/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:40.194382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:40.199975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:40.199975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.202256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8170a6ef9049519c3c3d344d4b7d52', 'request_id': 'req-32a697be-d0ab-4488-84e4-2dd7211a260b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:40.280944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] MFA Rules not processed for user `1ae02ee3dbce4dd187bc488b2179cfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:40.289051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:40.319772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8170a6ef9049519c3c3d344d4b7d52', 'request_id': 'req-32a697be-d0ab-4488-84e4-2dd7211a260b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:40.341633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] The token cache is being invalidate because project 5b8170a6ef9049519c3c3d344d4b7d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:40.346560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:40.348403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-32a697be-d0ab-4488-84e4-2dd7211a260b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:40.367777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 845/1698] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:39 2022] DELETE /identity/v3/projects/5b8170a6ef9049519c3c3d344d4b7d52 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:40.381473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533a78-ee24-456e-b94e-9ec2a5cc3d52 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:40.386500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533a78-ee24-456e-b94e-9ec2a5cc3d52 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:40.390542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533a78-ee24-456e-b94e-9ec2a5cc3d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.476470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-92533a78-ee24-456e-b94e-9ec2a5cc3d52 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:40.492689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-92533a78-ee24-456e-b94e-9ec2a5cc3d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:40.595080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 854/1699] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:40.613330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:40.616860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:40.670849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:40.674536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:40.745636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 846/1700] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:40.747202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:40.750438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:40.752287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.814625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] MFA Rules not processed for user `15aec8f2f71e4084a21cc0cfc3a52bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:40.814625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:40.842373 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fa6d-6a1c-4b28-9e2b-0aa9a1df3e62 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:40.868340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:40.870882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:40.871177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:40.871460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:40.947910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:40.949383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb12c12-f57a-489e-aa79-649f57a04a8e service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:40.996866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 855/1701] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:41.002386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.002795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.003591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.057553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 847/1702] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:41.074389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:41.077890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:41.092905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:41.096475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:41.139226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 856/1703] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:41.143559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:41.159773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751bc9d-1f04-46fd-9829-f92bca600a4f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:41.188631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e151-0457-422a-8066-56651d093476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:41.188631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e151-0457-422a-8066-56651d093476 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.188631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e151-0457-422a-8066-56651d093476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.188631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e151-0457-422a-8066-56651d093476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.192208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e151-0457-422a-8066-56651d093476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:41.192754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e151-0457-422a-8066-56651d093476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:41.194800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e151-0457-422a-8066-56651d093476 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:41.272011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 857/1704] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:08:41.275979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e151-0457-422a-8066-56651d093476 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:41.300474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e151-0457-422a-8066-56651d093476 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:41.315832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:41.316777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.317249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.317676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.318850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:41.320880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9ed8f-4c1a-4d7f-914c-49dbefd06bd7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:41.363444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef947f-f946-4c33-ac5e-026660261353 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:41.383947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:41.393045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.393045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.393045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.422090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:41.423696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:41.444450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 858/1705] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:41 2022] POST /identity/v3/projects => generated 355 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:08:41.446109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81168-7049-489a-816e-4d000337fc8a None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.447489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81168-7049-489a-816e-4d000337fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.447942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f81168-7049-489a-816e-4d000337fc8a None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.453765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 859/1706] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:08:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:41.454118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 848/1707] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:41.454956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f81168-7049-489a-816e-4d000337fc8a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:41.455079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:41.462474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-58f81168-7049-489a-816e-4d000337fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:41.503088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ef4b-8a19-4d56-8f6b-1e22b7eeeb8d service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:41.704722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f81168-7049-489a-816e-4d000337fc8a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:41.711961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:41.712666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.715649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.715649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.715649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:41.715896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:41.716229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17507e37-a308-47f8-87f4-d1b817dc143b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:41.718487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.718800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.719083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.723553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:41.725714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:41.838903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 849/1708] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:41 2022] POST /identity/v3/users => generated 278 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:41.843764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:41.846675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:41.847267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:41.939508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] MFA Rules not processed for user `e8410e3632ec4908824d336fff667da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:41.945240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:41.968674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:41.971124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d93d-7e9a-4d83-9af5-4b5080d943da service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:42.011720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 860/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:42.017500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c4277-2be6-4a83-9a3b-8b78113ce9ad None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.020602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c4277-2be6-4a83-9a3b-8b78113ce9ad None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.024863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c4277-2be6-4a83-9a3b-8b78113ce9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.106034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-006c4277-2be6-4a83-9a3b-8b78113ce9ad None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:42.107907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-006c4277-2be6-4a83-9a3b-8b78113ce9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:42.182659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:42.261850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 850/1710] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:42.263119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:42.332262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebced56f-7e6f-4f94-9e8d-b90691a2da2f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:42.350963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:42.354144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.355414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.355733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.372723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:42.381461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:42.416858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 861/1711] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:42.420813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.421249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.421719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.440299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 851/1712] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:42.441248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:42.478788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] MFA Rules not processed for user `e8410e3632ec4908824d336fff667da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:42.489613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:42.491863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedec3c-cd24-4cd2-bc42-f812f120fce1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:42.508141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:42.514176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.514176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.514176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.514176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:42.514176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:42.527660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 862/1713] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:42.536952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:42.564833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac2322-86d9-410d-aa5e-050dfaa48c09 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:42.583648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:42.586035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.589101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.589715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.590905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 852/1714] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:42.600513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:42.628515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:42.629612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9bbe3-5fb0-46ed-bd19-2c790f08126c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:42.630611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d4e69-ffca-41eb-97a5-7257ee07b24a service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:42.650790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:42.651902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.652194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.652879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] PATH_INFO: `/v3/projects/e25b3fb4d5f149888118f10cf92c9b32/users/057456047bc546698ef2a6f475869f64/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.656429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 863/1715] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:42.737551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25b3fb4d5f149888118f10cf92c9b32, user_id=057456047bc546698ef2a6f475869f64, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:42.742897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:42.847426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 853/1716] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:42 2022] PUT /identity/v3/projects/e25b3fb4d5f149888118f10cf92c9b32/users/057456047bc546698ef2a6f475869f64/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:42.849518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09432c-9bc6-4016-8647-80acde9082aa None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:42.849959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09432c-9bc6-4016-8647-80acde9082aa None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:42.850443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09432c-9bc6-4016-8647-80acde9082aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:42.940814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3a09432c-9bc6-4016-8647-80acde9082aa None None] MFA Rules not processed for user `057456047bc546698ef2a6f475869f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:42.943239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a09432c-9bc6-4016-8647-80acde9082aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:42.965074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:42.967345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:43.138172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 864/1717] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:43.148182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.148561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.148752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.197224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c851-a7fb-4887-b8b5-cf87e317ca8c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:43.211055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:43.211787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.212043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.212321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.238663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:43.243579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:43.256826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] MFA Rules not processed for user `288ab671062d409f98b91aeacde8b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:43.273120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 854/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:43.274294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:43.275505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:43.330052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:43.410387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a31c-28de-4cfd-ade7-ec7f1e289b4e service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:43.422313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:43.422998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.423281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.426184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.426184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:43.431787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:43.600912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 865/1719] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:43.628273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:43.632686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 855/1720] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:43 2022] POST /identity/v3/projects => generated 355 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:43.636064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:43.656026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5c097-f534-4020-b8ee-2506382d237c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:43.664806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:43.821461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab24dd-42b3-4371-9ee3-cdd855ddd330 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:43.827790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:43.828483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.830185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.830185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.830185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:43.831964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:43.888594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:43.897045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.901395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.902302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.942443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 856/1721] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:43 2022] POST /identity/v3/users => generated 284 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:43.946013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:43.969555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6e93-ba55-46f9-9890-2769c2ecb63d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:43.979506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:43.979506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:43.979506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:43.979506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:43.981195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:43.985017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:44.002506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 857/1722] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:44.006517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:44.030154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0e64-dadc-4ec5-8e15-85d5aa3a6d0e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:44.067771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:44.067771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:44.067771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:44.067771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] PATH_INFO: `/v3/projects/078b73b81dee49ada4bb221da0171144/users/b87b83948b1d4cd5851299218ed21833/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:44.108656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:44.110449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:44.134711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 866/1723] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:44.164649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=078b73b81dee49ada4bb221da0171144, user_id=b87b83948b1d4cd5851299218ed21833, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:44.165961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:44.274685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 858/1724] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:44 2022] PUT /identity/v3/projects/078b73b81dee49ada4bb221da0171144/users/b87b83948b1d4cd5851299218ed21833/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:08:44.275851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:44.311321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535275-63dd-4892-9e08-34d4870b0fdc service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:44.601206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:44.602012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:44.602301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:44.605523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:44.606279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:44.608875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd678d-93ee-413f-9835-cbb3ca5d29b4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:44.645438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 867/1725] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:44.649710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:44.671963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee0c4-3460-4bce-b6a3-ca962028f4bd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:44.687004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:44.689772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:44.690216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:44.690662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] PATH_INFO: `/v3/projects/078b73b81dee49ada4bb221da0171144/users/b87b83948b1d4cd5851299218ed21833/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:44.697996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=078b73b81dee49ada4bb221da0171144, user_id=b87b83948b1d4cd5851299218ed21833, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:44.706848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:44.747225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 859/1726] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:44 2022] PUT /identity/v3/projects/078b73b81dee49ada4bb221da0171144/users/b87b83948b1d4cd5851299218ed21833/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:44.749105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:44.749408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:44.749706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:44.840524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] MFA Rules not processed for user `b87b83948b1d4cd5851299218ed21833`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:44.842540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:44.951383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:45.077695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 868/1727] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:45.093097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:45.264573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:45.316267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef106-500b-4e4c-a4ee-546904cb922c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:45.353205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:45.354421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:45.355055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:45.355555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:45.379499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:45.383990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84766-0be9-424f-b289-f23efb7390da service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:45.451678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 860/1728] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:45.933032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:45.952565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7636b3-e2a4-4395-992a-83481ccc6c4a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:45.965421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:45.967955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:45.967955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:45.967955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:46.240044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:46.242195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:46.271262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 869/1729] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:47.573090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b98-9f91-49e3-9a8a-b128fe89d4e1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:47.573941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b98-9f91-49e3-9a8a-b128fe89d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:47.573941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b98-9f91-49e3-9a8a-b128fe89d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:47.636443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cbd89b98-9f91-49e3-9a8a-b128fe89d4e1 None None] MFA Rules not processed for user `e8410e3632ec4908824d336fff667da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:47.650216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cbd89b98-9f91-49e3-9a8a-b128fe89d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:47.829542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 861/1730] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:49.122580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:49.124293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:49.292648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00aeab-17e1-498f-b54a-a8927879274a service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:49.303402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:49.304519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:49.304887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:49.305233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] PATH_INFO: `/v3/users/b40cc5adbd25485aa2059b421e15b289` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:49.306891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40cc5adbd25485aa2059b421e15b289)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:49.309738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:49.654644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40cc5adbd25485aa2059b421e15b289'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:49.656030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40cc5adbd25485aa2059b421e15b289'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:49.778669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40cc5adbd25485aa2059b421e15b289'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:49.799345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:49.804837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40cc5adbd25485aa2059b421e15b289'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:49.822300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a909b0e-796d-4e3c-83d0-ee5558b15bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40cc5adbd25485aa2059b421e15b289'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:49.842769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 870/1731] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:49 2022] DELETE /identity/v3/users/b40cc5adbd25485aa2059b421e15b289 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:49.844571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3225e2-02dd-4267-aa89-9bc0af2bc017 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:49.845103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3225e2-02dd-4267-aa89-9bc0af2bc017 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:49.845195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3225e2-02dd-4267-aa89-9bc0af2bc017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:49.881374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:49.882048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:49.882048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:49.887747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8e3225e2-02dd-4267-aa89-9bc0af2bc017 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:49.892390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8e3225e2-02dd-4267-aa89-9bc0af2bc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:49.921429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] MFA Rules not processed for user `15aec8f2f71e4084a21cc0cfc3a52bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:49.922731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:50.032481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 871/1732] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:50.041816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 862/1733] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:50.058497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:50.064567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:50.293195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30a03-c738-4235-b602-e6c564f3e878 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:50.306317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:50.307031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:50.307317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:50.307653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:50.335256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:50.341305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fe0e-397f-4bdf-bff7-b524ff4d15b5 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:50.360193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 872/1734] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:51.579736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db509cc-7010-4ffe-abd4-a87e700cfd2c None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:51.580632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db509cc-7010-4ffe-abd4-a87e700cfd2c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:51.581063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db509cc-7010-4ffe-abd4-a87e700cfd2c None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:51.583159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 863/1735] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 6 13:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:51.606596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:51.607863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:51.608299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:51.667213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:51.669379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:51.708163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:51.708163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:51.708394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:51.731804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 873/1736] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:51.750239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] MFA Rules not processed for user `9c620175b84d4cee9aef398864c03c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:51.758747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:51.776359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:51.779947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:51.809783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddd56-3361-4d6d-9320-1002539b4f3a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:51.821543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:51.822212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:51.822498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:51.822779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:51.853168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:51.855337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f05fe-51a7-4ab7-902d-2707b2f39f4d service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:51.873403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 874/1737] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:51.936110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 864/1738] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:51.940615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:51.940915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:51.941199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:51.983733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] MFA Rules not processed for user `288ab671062d409f98b91aeacde8b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:51.985347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:52.035300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:52.039846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:52.063070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8592c7-5c4e-410c-b78c-a6fabb90f75d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:52.070509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:52.072186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:52.072801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:52.073278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] PATH_INFO: `/v3/projects/eac8416ab31041d694991d2e5f853530` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:52.074935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac8416ab31041d694991d2e5f853530)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:52.099272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:52.132564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 875/1739] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:52.291216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:52.305534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac8416ab31041d694991d2e5f853530', 'request_id': 'req-c8bb4729-44c4-406e-83bc-370c7590a0d3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.317269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac8416ab31041d694991d2e5f853530', 'request_id': 'req-c8bb4729-44c4-406e-83bc-370c7590a0d3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.409627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac8416ab31041d694991d2e5f853530', 'request_id': 'req-c8bb4729-44c4-406e-83bc-370c7590a0d3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.431147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] The token cache is being invalidate because project eac8416ab31041d694991d2e5f853530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:52.431740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.438434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.438434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 865/1740] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:52 2022] DELETE /identity/v3/projects/eac8416ab31041d694991d2e5f853530 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:52.440214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:52.457223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9568aa1-54b2-4390-a5b6-b930b1ea18a4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:52.491399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:52.556520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:52.557426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:52.557714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:52.557993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] PATH_INFO: `/v3/users/3e9b360d18224f8d9b0dd9888630ef98` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:52.560233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9b360d18224f8d9b0dd9888630ef98)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:52.562184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:52.787448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9b360d18224f8d9b0dd9888630ef98'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.789285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9b360d18224f8d9b0dd9888630ef98'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.865498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9b360d18224f8d9b0dd9888630ef98'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.911751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9b360d18224f8d9b0dd9888630ef98'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.931225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-99cc4d60-4014-48db-933b-29919eda0dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9b360d18224f8d9b0dd9888630ef98'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:52.940329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 876/1741] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:52 2022] DELETE /identity/v3/users/3e9b360d18224f8d9b0dd9888630ef98 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:53.813558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:53.813558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:53.823850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4729-44c4-406e-83bc-370c7590a0d3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:53.909238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:53.910473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:53.910762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:53.911052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] PATH_INFO: `/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:53.912558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1deee1fe48476b8fc6fed1e9262cf4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:53.914470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:54.075428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1deee1fe48476b8fc6fed1e9262cf4', 'request_id': 'req-6aa5266e-608b-4f9e-ae09-4cc823fe8456'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:54.090519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1deee1fe48476b8fc6fed1e9262cf4', 'request_id': 'req-6aa5266e-608b-4f9e-ae09-4cc823fe8456'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:54.227035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1deee1fe48476b8fc6fed1e9262cf4', 'request_id': 'req-6aa5266e-608b-4f9e-ae09-4cc823fe8456'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:54.257297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] The token cache is being invalidate because project ce1deee1fe48476b8fc6fed1e9262cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:08:54.258024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:54.259833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6aa5266e-608b-4f9e-ae09-4cc823fe8456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:54.261450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 866/1742] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:08:53 2022] DELETE /identity/v3/projects/ce1deee1fe48476b8fc6fed1e9262cf4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:54.268080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:54.272390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:54.272390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:54.331276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:54.333573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:54.415262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 877/1743] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:54.424068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599337b-cf63-443b-8daf-19d19903146f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:54.424485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599337b-cf63-443b-8daf-19d19903146f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:54.424974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599337b-cf63-443b-8daf-19d19903146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:54.467764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9599337b-cf63-443b-8daf-19d19903146f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:54.469599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9599337b-cf63-443b-8daf-19d19903146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:54.501150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 867/1744] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:54.503264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:54.522134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58247d5-0fb6-403e-ac69-ef4955ff9aba None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:54.532787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:54.534651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:54.535158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:54.535676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:54.537821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:08:54.539927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:54.541910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:54.565401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 878/1745] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:08:54.573642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599337b-cf63-443b-8daf-19d19903146f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:54.576829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599337b-cf63-443b-8daf-19d19903146f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:54.601155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:54.601943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:54.604066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:54.606585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:54.607384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:54.617060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:54.817481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 868/1746] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:54 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:08:54.822053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:54.835188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62e00c-275b-4b2a-a940-3b50d2a7faf1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:54.906421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:55.009353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:55.010150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:55.010445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:55.010725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:55.011424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:55.013488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:55.171226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 879/1747] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:54 2022] POST /identity/v3/users => generated 292 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:55.172297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:55.191597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723e3fe-8628-4a15-8275-0b844372a8f1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:55.221328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:55.225068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:55.225616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:55.226012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:55.232763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:55.236234 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:55.313935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 869/1748] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:55.314919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:55.336565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1f8b-5df8-4654-a6f1-8e2457104ccf admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:55.359392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:55.360562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:55.361343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:55.363506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:55.363506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:55.364877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fcedf-9f79-4d48-bfaf-1eedd84fddde admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:55.404691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 880/1749] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:55.408546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:55.462514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10caaa8-3db3-4e4b-b53e-657ca3d8bea4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:55.481465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:55.484119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:55.485604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:55.486177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] PATH_INFO: `/v3/projects/141118364c2c4f9fa4d6b4e101700fb2/users/ac8b5e65c3624ea4939f1aabaaab7353/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:55.519405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:55.529504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141118364c2c4f9fa4d6b4e101700fb2, user_id=ac8b5e65c3624ea4939f1aabaaab7353, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:55.547080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:55.631333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 870/1750] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:55 2022] PUT /identity/v3/projects/141118364c2c4f9fa4d6b4e101700fb2/users/ac8b5e65c3624ea4939f1aabaaab7353/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:55.643188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:55.643486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:55.643813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:55.733879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] MFA Rules not processed for user `ac8b5e65c3624ea4939f1aabaaab7353`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:55.735088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:55.930056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 881/1751] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:55.944424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.022940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98d13-7a5c-491c-b38c-0e9b5b3824f4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.029431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.032048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.032048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.032048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.032048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.035222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.161015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 871/1752] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:08:55 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:56.162242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.186879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b70f6-3366-4112-abe4-af2eea46f65a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.276276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.277049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.277971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.278250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.279055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.281406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.393091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 882/1753] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:08:56 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:08:56.398595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.414479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320f4e-3e71-4b3f-b7fe-0c98dc3600dc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.422351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.423211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.423694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.423976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.430402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.430402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.445242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 872/1754] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:08:56.449878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.463127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c28ce0-0033-49dd-ab0d-202b50b5918a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.469249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.470246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.470604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.470953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] PATH_INFO: `/v3/projects/950c9024cea54f90b940a1b6c2b0953b/users/f48969086ed34fba8c1d43b2c9af3858/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.505494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=950c9024cea54f90b940a1b6c2b0953b, user_id=f48969086ed34fba8c1d43b2c9af3858, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.513515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e61ad-30cb-4ccf-822c-94d848c6cb1b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.670630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 883/1755] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:56 2022] PUT /identity/v3/projects/950c9024cea54f90b940a1b6c2b0953b/users/f48969086ed34fba8c1d43b2c9af3858/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:56.674450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.688836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1819a-54d8-4147-9f9b-f77c8b517195 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.837502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.838256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.841155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28991db-5806-434b-868c-920500fb3bd6 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.841743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28991db-5806-434b-868c-920500fb3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.842274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28991db-5806-434b-868c-920500fb3bd6 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.842380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.842560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.843334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.845039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f7e29-2a7b-4926-a87f-a07557374c3f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.845357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 884/1756] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:08:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:08:56.858406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 873/1757] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:08:56.862921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28991db-5806-434b-868c-920500fb3bd6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:56.896401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28991db-5806-434b-868c-920500fb3bd6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:56.904574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:56.905481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.905801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.906270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] PATH_INFO: `/v3/projects/950c9024cea54f90b940a1b6c2b0953b/users/f48969086ed34fba8c1d43b2c9af3858/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.909280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=950c9024cea54f90b940a1b6c2b0953b, user_id=f48969086ed34fba8c1d43b2c9af3858, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:56.915228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:56.943637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 885/1758] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:08:56 2022] PUT /identity/v3/projects/950c9024cea54f90b940a1b6c2b0953b/users/f48969086ed34fba8c1d43b2c9af3858/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:56.956108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0f6-559f-4661-9bae-10f1a213ad30 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:56.956702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0f6-559f-4661-9bae-10f1a213ad30 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:56.956829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0f6-559f-4661-9bae-10f1a213ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:56.997085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-226ec0f6-559f-4661-9bae-10f1a213ad30 None None] MFA Rules not processed for user `f48969086ed34fba8c1d43b2c9af3858`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:56.998920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-226ec0f6-559f-4661-9bae-10f1a213ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:57.170455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 874/1759] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:57.178568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:57.183065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:57.184141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:57.186018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:57.187940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:57.254455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:57.255759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:57.362024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4287-d1dc-41f4-a6b1-7126db69ed6f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:57.382346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:57.383026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:57.383317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:57.383626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:57.403934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:57.407286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:57.430062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 886/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:57.439913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 875/1761] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:08:57.762935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:57.762935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:57.796051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2119a-24d8-4fac-a139-50886c660064 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:57.814532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:57.824857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:57.825314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:57.825535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:57.828732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:57.842169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fb936-7ac8-491d-8f10-be4aa159fd57 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:57.857929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:57.858974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:57.859461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:57.860109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:57.868758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:57.877681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:57.906773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 887/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:08:57.954114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:57.956251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b71de-1b06-4304-824d-f33c4d765319 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:57.978667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 876/1763] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:08:58.441387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:58.810879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:58.836618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:59.001280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43ce7e-feae-418f-a7bc-ff46fe324331 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:59.006818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:59.007762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:59.008047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:59.008335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] PATH_INFO: `/v3/users/ac8b5e65c3624ea4939f1aabaaab7353` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:59.009561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8b5e65c3624ea4939f1aabaaab7353)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:59.013187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:59.235714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8b5e65c3624ea4939f1aabaaab7353'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:59.242390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8b5e65c3624ea4939f1aabaaab7353'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:59.310129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8b5e65c3624ea4939f1aabaaab7353'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:59.354418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8b5e65c3624ea4939f1aabaaab7353'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:59.366382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8b5e65c3624ea4939f1aabaaab7353'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:08:59.391361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d00e-1f92-43cf-8212-22b514d5bbf3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:59.391876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 888/1764] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:08:58 2022] DELETE /identity/v3/users/ac8b5e65c3624ea4939f1aabaaab7353 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:08:59.392321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d00e-1f92-43cf-8212-22b514d5bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:59.392593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d00e-1f92-43cf-8212-22b514d5bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:59.431496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3d58d00e-1f92-43cf-8212-22b514d5bbf3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:08:59.432974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3d58d00e-1f92-43cf-8212-22b514d5bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:59.590962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 877/1765] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:08:59.685602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:08:59.687502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:08:59.809478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44af4b-fd46-4571-97cb-28e7af184d75 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:08:59.836256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:08:59.838020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:08:59.838390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:08:59.838741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:08:59.865670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:08:59.867368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525078-7fd2-4900-9423-a7325011819d service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:08:59.882276 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 889/1766] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:00.477896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:01.348907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:01.349463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:01.349463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:01.351170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 878/1767] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:09:01.359984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:01.361285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:01.361579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:01.395349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:01.396345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:01.501937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 890/1768] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:01.965107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:01.968166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:01.976449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:01.986670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:02.062175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17b28-4930-4cad-be98-b7608c2c90da None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:02.082881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:02.082881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:02.082881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:02.082881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] PATH_INFO: `/v3/projects/141118364c2c4f9fa4d6b4e101700fb2` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:02.085733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141118364c2c4f9fa4d6b4e101700fb2)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:02.087949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:02.098196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9faca6-c418-4e36-9c10-658e8094e419 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:02.125946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:02.126884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:02.128964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:02.129493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:02.151757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:02.155414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:02.181203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 879/1769] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:02.279979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141118364c2c4f9fa4d6b4e101700fb2', 'request_id': 'req-52145809-bd4a-4e21-95a1-4aed9741d619'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.393882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141118364c2c4f9fa4d6b4e101700fb2', 'request_id': 'req-52145809-bd4a-4e21-95a1-4aed9741d619'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.402642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141118364c2c4f9fa4d6b4e101700fb2', 'request_id': 'req-52145809-bd4a-4e21-95a1-4aed9741d619'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.422791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] The token cache is being invalidate because project 141118364c2c4f9fa4d6b4e101700fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:02.424016 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.425907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.431147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 891/1770] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:01 2022] DELETE /identity/v3/projects/141118364c2c4f9fa4d6b4e101700fb2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:02.435986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:02.443567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:02.450990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b8e1b-b251-428b-86dd-c10b5164d8a0 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:02.531563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:02.532796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:02.533387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:02.533810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] PATH_INFO: `/v3/users/f48969086ed34fba8c1d43b2c9af3858` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:02.535892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48969086ed34fba8c1d43b2c9af3858)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:02.538343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:02.796768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48969086ed34fba8c1d43b2c9af3858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.797712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48969086ed34fba8c1d43b2c9af3858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.831263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48969086ed34fba8c1d43b2c9af3858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.866375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48969086ed34fba8c1d43b2c9af3858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:02.988901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-02c90b8d-753d-4980-9ea9-86e4e27bd3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48969086ed34fba8c1d43b2c9af3858'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:03.004596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 880/1771] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:02 2022] DELETE /identity/v3/users/f48969086ed34fba8c1d43b2c9af3858 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:04.117648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:04.119592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:04.151502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52145809-bd4a-4e21-95a1-4aed9741d619 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:04.162107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:04.213571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:04.214474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.215035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.215577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] PATH_INFO: `/v3/projects/950c9024cea54f90b940a1b6c2b0953b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.216888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950c9024cea54f90b940a1b6c2b0953b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:04.218769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:04.354564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950c9024cea54f90b940a1b6c2b0953b', 'request_id': 'req-21e449ee-262b-4879-ab5b-af346f1a9694'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:04.468255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950c9024cea54f90b940a1b6c2b0953b', 'request_id': 'req-21e449ee-262b-4879-ab5b-af346f1a9694'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:04.474185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950c9024cea54f90b940a1b6c2b0953b', 'request_id': 'req-21e449ee-262b-4879-ab5b-af346f1a9694'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:04.486257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] The token cache is being invalidate because project 950c9024cea54f90b940a1b6c2b0953b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:04.486545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:04.487186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-21e449ee-262b-4879-ab5b-af346f1a9694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:04.488766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 892/1772] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:04 2022] DELETE /identity/v3/projects/950c9024cea54f90b940a1b6c2b0953b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:04.493781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.494241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.494370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.513254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:04.514464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:04.576220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 881/1773] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:04.585239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.585589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.585872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.611844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:04.613176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:04.627684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:04.628492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 893/1774] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:04.645522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890809dd-7d9f-445a-982b-31423056d8ba None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:04.653664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:04.656580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.657269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.657737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.658992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:04.659745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:04.662863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:04.682502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:04.689872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 882/1775] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:09:04.695303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8f9a-9288-43d3-9c2e-fa641c087388 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:04.709997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:04.710762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.711114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.711651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.712705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:04.715427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:04.826307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 894/1776] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:04.830577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:04.842202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ddafa-be65-4459-b701-b57602d1f155 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:04.848479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:04.918999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:04.920101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:04.921065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:04.921555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:04.922460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:04.924769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:05.026856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 883/1777] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:04 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:05.040560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:05.054952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1825a-cd07-4962-a62b-809f7ab0acdd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:05.061008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:05.062188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:05.062868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:05.062868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:05.063796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:05.065231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:05.097446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 895/1778] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:05.100885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:05.113836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a77b1-bd77-4497-836d-1f2f719a2e8b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:05.124980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:05.125965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:05.127822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:05.128377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:05.129358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:05.131213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f242c2-d714-4385-9d09-4ed058011b3b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:05.160968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 884/1779] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:05.162862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:05.180690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef3e72-da54-4f73-a309-32d0d861a2b1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:05.194258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:05.195306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:05.196450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:05.202168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] PATH_INFO: `/v3/projects/22c0df8bdb0e419eb8d2f2efc056d706/users/1f3c233944274ccc9a08121eb0c0884b/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:05.232198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c0df8bdb0e419eb8d2f2efc056d706, user_id=1f3c233944274ccc9a08121eb0c0884b, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:05.235036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:05.330866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 896/1780] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:05 2022] PUT /identity/v3/projects/22c0df8bdb0e419eb8d2f2efc056d706/users/1f3c233944274ccc9a08121eb0c0884b/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:05.336473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204b5e-456a-47d2-b962-b400b222a8ea None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:05.336769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204b5e-456a-47d2-b962-b400b222a8ea None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:05.339724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204b5e-456a-47d2-b962-b400b222a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:05.378431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-75204b5e-456a-47d2-b962-b400b222a8ea None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:05.379716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-75204b5e-456a-47d2-b962-b400b222a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:05.498953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 885/1781] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:05.506041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:05.509000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:05.590866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83148d8-5853-44b4-9cae-9bedd2d4a721 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:05.598416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:05.603643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:05.603643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:05.603643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:05.614100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:05.615614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:05.629163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 897/1782] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:06.658949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:07.447626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:07.448084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:07.448878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:07.482258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] MFA Rules not processed for user `1f3c233944274ccc9a08121eb0c0884b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:07.484451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:07.586770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 886/1783] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:07.590995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:07.602863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180e05-52b6-484b-ba71-0d1467569000 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:07.608966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:07.609937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:07.610378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:07.610829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:07.611852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:07.614073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:07.746178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 898/1784] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:07 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:07.750639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:07.765250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96176e9-b698-4dcf-8d71-fc13c63ea2b2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:07.831131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:07.831852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:07.832160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:07.832434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:07.833337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:07.836179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:07.937202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 887/1785] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:07 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:07.941653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:07.955630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2fae8-5c3b-4391-897b-7b6816f09300 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:07.963177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:07.964486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:07.965531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:07.970435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:07.970435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:07.970435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:07.986989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 899/1786] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:07.988560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:08.007654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84df1d-54b7-412c-b411-5b8abadb8aef admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:08.014165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:08.015489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:08.015883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:08.016423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] PATH_INFO: `/v3/projects/0f3e61b037b34478956236c9e7c3730a/users/0b31b194a71243e996cf1dc0ec979810/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:08.035484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3e61b037b34478956236c9e7c3730a, user_id=0b31b194a71243e996cf1dc0ec979810, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:08.040073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:08.121034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 888/1787] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:07 2022] PUT /identity/v3/projects/0f3e61b037b34478956236c9e7c3730a/users/0b31b194a71243e996cf1dc0ec979810/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:08.124788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:08.136376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dda4f-2ce5-4b48-a6a9-b50d1e72e3e0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:08.212514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:08.213418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:08.214342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:08.214941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:08.216063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:08.218495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1500a-4b8d-4c43-99d5-23b12e0162dd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:08.231385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 900/1788] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:08.235713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:08.246183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198e3c-346a-4991-959d-a82f90fd8830 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:08.250882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:08.251793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:08.252153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:08.252354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] PATH_INFO: `/v3/projects/0f3e61b037b34478956236c9e7c3730a/users/0b31b194a71243e996cf1dc0ec979810/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:08.254815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3e61b037b34478956236c9e7c3730a, user_id=0b31b194a71243e996cf1dc0ec979810, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:08.257547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:08.272845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 889/1789] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:08 2022] PUT /identity/v3/projects/0f3e61b037b34478956236c9e7c3730a/users/0b31b194a71243e996cf1dc0ec979810/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:08.361985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:10.223324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:10.224287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:10.224750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:10.256888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:10.260057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:10.272586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] MFA Rules not processed for user `0b31b194a71243e996cf1dc0ec979810`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:10.274017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:10.357388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e98bf-1119-41da-a849-06a26197bc81 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:10.362786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:10.363829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:10.369068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:10.369723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] PATH_INFO: `/v3/users/057456047bc546698ef2a6f475869f64` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:10.372138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057456047bc546698ef2a6f475869f64)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:10.374222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:10.374808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 901/1790] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:10.387280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:10.388820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:10.475262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c2330-1506-4f1b-973e-c29a42f39d4a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:10.480515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:10.481379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:10.482170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:10.483303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:10.550451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:10.552521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdf35d-b625-4b38-b195-d2a8544b7124 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:10.564317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 902/1791] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:10.625437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057456047bc546698ef2a6f475869f64'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:10.626321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057456047bc546698ef2a6f475869f64'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:10.661785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057456047bc546698ef2a6f475869f64'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:10.688874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057456047bc546698ef2a6f475869f64'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:10.789959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057456047bc546698ef2a6f475869f64'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:10.796547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 890/1792] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:10 2022] DELETE /identity/v3/users/057456047bc546698ef2a6f475869f64 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:10.801085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:10.801386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:10.801674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:10.819972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:10.821196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:10.889731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:10.894006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 903/1793] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:10.903956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:10.905455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:10.971218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159f8d-d5ec-4284-a07e-be47b887bed0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:10.974795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:10.975437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:10.975752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:10.976029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:10.985834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:10.987294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:10.997579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 891/1794] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:11.059421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:11.477814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:11.479977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:11.498700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b8fe-0925-4f83-a17d-d70eca7e4e84 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:11.504114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:11.505194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:11.505660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:11.506264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] PATH_INFO: `/v3/projects/e25b3fb4d5f149888118f10cf92c9b32` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:11.508669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25b3fb4d5f149888118f10cf92c9b32)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:11.512429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:11.624507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25b3fb4d5f149888118f10cf92c9b32', 'request_id': 'req-890356b1-7dc6-43cd-b9d6-fc7593c60749'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:11.744150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25b3fb4d5f149888118f10cf92c9b32', 'request_id': 'req-890356b1-7dc6-43cd-b9d6-fc7593c60749'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:11.752629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25b3fb4d5f149888118f10cf92c9b32', 'request_id': 'req-890356b1-7dc6-43cd-b9d6-fc7593c60749'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:11.763411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] The token cache is being invalidate because project e25b3fb4d5f149888118f10cf92c9b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:11.763963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:11.765860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:11.767419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 904/1795] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:11 2022] DELETE /identity/v3/projects/e25b3fb4d5f149888118f10cf92c9b32 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:11.771446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:11.783960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b72eba-304d-4726-a14a-feba76d12101 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:11.844013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:11.845128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:11.845414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:11.845698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] PATH_INFO: `/v3/users/b87b83948b1d4cd5851299218ed21833` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:11.847038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87b83948b1d4cd5851299218ed21833)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:11.851959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:12.047044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87b83948b1d4cd5851299218ed21833'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:12.047737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87b83948b1d4cd5851299218ed21833'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:12.054636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87b83948b1d4cd5851299218ed21833'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:12.066933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87b83948b1d4cd5851299218ed21833'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:12.170288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87b83948b1d4cd5851299218ed21833'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:12.177649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 892/1796] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:11 2022] DELETE /identity/v3/users/b87b83948b1d4cd5851299218ed21833 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:12.572179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:12.574352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:12.629561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:12.640632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890356b1-7dc6-43cd-b9d6-fc7593c60749 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:12.728555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:12.730800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:12.732715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:12.733310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:12.738093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:12.752524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:12.758497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:12.854842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:12.856788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a63dac-cbb6-4aa7-b3f4-3b3809d7cb43 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:12.875088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd348a03-d6b1-447a-b6a3-caaf4d94051d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:12.879739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 905/1797] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:12.880368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:12.881254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:12.881542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:12.881832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] PATH_INFO: `/v3/projects/078b73b81dee49ada4bb221da0171144` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:12.883020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=078b73b81dee49ada4bb221da0171144)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:12.885245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.013005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078b73b81dee49ada4bb221da0171144', 'request_id': 'req-475d31a0-c9c9-4529-98de-e25921e1de3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:13.019430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078b73b81dee49ada4bb221da0171144', 'request_id': 'req-475d31a0-c9c9-4529-98de-e25921e1de3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:13.139571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078b73b81dee49ada4bb221da0171144', 'request_id': 'req-475d31a0-c9c9-4529-98de-e25921e1de3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:13.153692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] The token cache is being invalidate because project 078b73b81dee49ada4bb221da0171144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:13.154073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:13.154827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-475d31a0-c9c9-4529-98de-e25921e1de3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:13.156966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 893/1798] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:12 2022] DELETE /identity/v3/projects/078b73b81dee49ada4bb221da0171144 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:13.162588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.163027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.167128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.184551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:13.185763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:13.253271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 906/1799] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:13.261639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.261931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.262210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.281635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:13.282791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:13.291120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 894/1800] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:13.295671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.305948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e9e4-d99f-413b-98c3-11b0422c1f25 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.310924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.311637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.312038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.312326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.313099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:13.313413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.315050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.343591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 907/1801] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:13.344308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.355611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628175f-ccd5-4bd6-9cf6-949b9885e8ba None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.362970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.363852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.364279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.364693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.365721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.368393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.424920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:13.484484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 895/1802] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:13 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:13.489878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.505533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f7cbb-b1b1-4ccb-8bf1-c8fe2d2d9c87 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.584850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.585529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.585863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.586244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.588944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.591738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.683545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 908/1803] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:13 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:13.685346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.697090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff9b3-dd73-46a6-9daa-31afd80f3cab admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.704252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.704932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.705218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.707431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.707431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.707890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.720262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 896/1804] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:13.724561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.736926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603ef0-a836-4ac1-b808-857bfc63a0fd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.743063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.743841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.744180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.744503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.745980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.748088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110abf-587f-4af1-9fbd-26d133f64ba2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.759156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 909/1805] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:13.763880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:13.775367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ceff-e788-4605-b4ae-1f503c59f5f9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:13.780782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:13.781762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.782047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.782416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] PATH_INFO: `/v3/projects/50278424691d4ebab51dfa1c5ff4d634/users/c38972f01ef748b78dc052c3b9184664/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.798922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50278424691d4ebab51dfa1c5ff4d634, user_id=c38972f01ef748b78dc052c3b9184664, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:13.801596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:13.901804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 897/1806] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:13 2022] PUT /identity/v3/projects/50278424691d4ebab51dfa1c5ff4d634/users/c38972f01ef748b78dc052c3b9184664/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:13.904618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:13.905010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:13.905371 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:13.934822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] MFA Rules not processed for user `c38972f01ef748b78dc052c3b9184664`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:13.936128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:14.004602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 910/1807] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:14.009035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.071408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0023e1-d996-40f3-b72d-f5b66fee0746 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.076490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.077145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.077432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.077712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.078413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.080331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.201224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 898/1808] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:14 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:14.205268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.217081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723423-b090-44ed-9337-defaa9134e08 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.274263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.274944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.275231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.275806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.276603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.278518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.313349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:14.344002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 911/1809] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:14 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:14.347814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.358431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e54f-a334-4a39-8aa9-560218755c53 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.363111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.367102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.367102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.367102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.367102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.367102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.378921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 899/1810] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:14.384545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.395273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2ae43-5103-4d5d-bda0-3b2f25f9a8ae admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.403725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.404646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.405007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.405324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] PATH_INFO: `/v3/projects/a08fb7f7d4a84c859f287dab720e643b/users/b56432a507e746099290f778caf90804/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.420613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08fb7f7d4a84c859f287dab720e643b, user_id=b56432a507e746099290f778caf90804, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.423280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.481369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 912/1811] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:14 2022] PUT /identity/v3/projects/a08fb7f7d4a84c859f287dab720e643b/users/b56432a507e746099290f778caf90804/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:14.485339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.496937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2393b-a3f5-453c-8108-5f43b1cd268b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.555034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.555779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.556085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.556360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.557831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.559698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eae74-ffcc-405d-a8da-a7b61c076529 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.569769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 900/1812] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:14.576780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.587299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd1bdc-2c95-42ad-97ba-b380fc127aef admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.592007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.595211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.595211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.595211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] PATH_INFO: `/v3/projects/a08fb7f7d4a84c859f287dab720e643b/users/b56432a507e746099290f778caf90804/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.595478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08fb7f7d4a84c859f287dab720e643b, user_id=b56432a507e746099290f778caf90804, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.598089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.608946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 913/1813] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:14 2022] PUT /identity/v3/projects/a08fb7f7d4a84c859f287dab720e643b/users/b56432a507e746099290f778caf90804/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:14.625538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.625836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.626120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.652232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] MFA Rules not processed for user `b56432a507e746099290f778caf90804`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:14.653496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:14.704027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:14.720231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 901/1814] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:14.731960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.733717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:14.749685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:14.792795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc67-12ba-4991-9d3a-c8a868189faa admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.796812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.797470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.797760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.798039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.807697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.809129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcb56b-c7e0-4eb7-bd8d-e833d58f50e4 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:14.818950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 914/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:14.849750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:14.917331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2f6db-ac78-467c-9b6f-34e74bb27a63 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:14.922462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:14.923342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:14.923661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:14.923947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] PATH_INFO: `/v3/users/c38972f01ef748b78dc052c3b9184664` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:14.925174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38972f01ef748b78dc052c3b9184664)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:14.927264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:15.281089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38972f01ef748b78dc052c3b9184664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:15.281743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38972f01ef748b78dc052c3b9184664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:15.288679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38972f01ef748b78dc052c3b9184664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:15.300561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38972f01ef748b78dc052c3b9184664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:15.387467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38972f01ef748b78dc052c3b9184664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:15.394213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 902/1816] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:14 2022] DELETE /identity/v3/users/c38972f01ef748b78dc052c3b9184664 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:15.398652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:15.398947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:15.399227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:15.418830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:15.420177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:15.484068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 915/1817] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:15.493404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:15.495795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:15.553419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d7ad-8756-4cbf-99d5-a6fa017f6e7f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:15.558368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:15.559018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:15.559311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:15.559622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:15.568625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:15.570053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:15.580008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 903/1818] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:15.748005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:15.981320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:15.984998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:16.019323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b97036-d0fe-489e-8a18-762674207a4b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:16.025025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:16.032005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:16.032005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:16.032005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] PATH_INFO: `/v3/projects/50278424691d4ebab51dfa1c5ff4d634` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:16.032005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50278424691d4ebab51dfa1c5ff4d634)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:16.032005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:16.168288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50278424691d4ebab51dfa1c5ff4d634', 'request_id': 'req-5dc0120c-2a38-41a1-ad02-323527b8a152'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.241039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50278424691d4ebab51dfa1c5ff4d634', 'request_id': 'req-5dc0120c-2a38-41a1-ad02-323527b8a152'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.244573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:16.249188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50278424691d4ebab51dfa1c5ff4d634', 'request_id': 'req-5dc0120c-2a38-41a1-ad02-323527b8a152'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.266186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] The token cache is being invalidate because project 50278424691d4ebab51dfa1c5ff4d634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:16.266486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.267231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.269179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 916/1819] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:15 2022] DELETE /identity/v3/projects/50278424691d4ebab51dfa1c5ff4d634 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:16.280006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:16.289843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a39c59-95a8-4da1-8739-e349d4a8941b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:16.348238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:16.356866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:16.357826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:16.358116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:16.358763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] PATH_INFO: `/v3/users/b56432a507e746099290f778caf90804` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:16.359640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56432a507e746099290f778caf90804)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:16.361585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:16.518618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56432a507e746099290f778caf90804'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.519491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56432a507e746099290f778caf90804'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.528340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56432a507e746099290f778caf90804'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.542076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56432a507e746099290f778caf90804'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.613172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9688d96f-c394-4483-bb41-f4330bf2c22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56432a507e746099290f778caf90804'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:16.622267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 904/1820] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:16 2022] DELETE /identity/v3/users/b56432a507e746099290f778caf90804 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:17.194914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:17.196536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:17.212640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0120c-2a38-41a1-ad02-323527b8a152 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:17.277141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:17.279023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.279023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.279023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] PATH_INFO: `/v3/projects/a08fb7f7d4a84c859f287dab720e643b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.280823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08fb7f7d4a84c859f287dab720e643b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:17.283707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:17.418267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08fb7f7d4a84c859f287dab720e643b', 'request_id': 'req-a62c55bb-4aa7-4790-9b36-c287c8836995'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:17.469372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08fb7f7d4a84c859f287dab720e643b', 'request_id': 'req-a62c55bb-4aa7-4790-9b36-c287c8836995'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:17.476751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08fb7f7d4a84c859f287dab720e643b', 'request_id': 'req-a62c55bb-4aa7-4790-9b36-c287c8836995'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:17.489626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] The token cache is being invalidate because project a08fb7f7d4a84c859f287dab720e643b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:17.489947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:17.490637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a62c55bb-4aa7-4790-9b36-c287c8836995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:17.492238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 917/1821] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:17 2022] DELETE /identity/v3/projects/a08fb7f7d4a84c859f287dab720e643b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:17.497822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.498319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.498467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.517744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:17.519039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:17.583281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 905/1822] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:17.590983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.591278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.591588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.610325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:17.611534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:17.619262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 918/1823] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:17.623993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:17.633511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03683-2e71-4c02-b65f-084f3a50a961 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:17.638066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:17.638712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.638996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.639271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.640269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:17.640574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:17.642151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:17.653290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 906/1824] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:17.657246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:17.666781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559dc55-3d6c-44af-ad3f-874d172d53f0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:17.671430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:17.672107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.672393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.672669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.673349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:17.675220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:17.773947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 919/1825] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:17 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:17.778477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:17.788317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46c1e1-4f5a-483d-a4f2-c1155ba9bd7e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:17.847831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:17.847831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.847831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.847831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.848240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:17.850108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:17.858805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:17.961388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 907/1826] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:17 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:17.966043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:17.976436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156166-4e88-4bb7-92a9-5225a13d6c6e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:17.982219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:17.982884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:17.983166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:17.983442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:17.984239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:17.985815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:17.996711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 920/1827] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:18.000680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.011077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c43c1-5f8e-44be-8bfe-217bc643323e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.016124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.016847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.017135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.017417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.018172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.019834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec932ae-a693-415b-ae73-e1b45439ec2c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.031556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 908/1828] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:18.035171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.045859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20580f-5d9c-4605-b1f4-b06b4ccd7f3d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.051031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.051517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.051827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.052103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] PATH_INFO: `/v3/projects/e7bd4f845aaa4fb2939e5cfe6007a155/users/5e1d47b9708f453ba901a0f3fdc2b8bd/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.066239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bd4f845aaa4fb2939e5cfe6007a155, user_id=5e1d47b9708f453ba901a0f3fdc2b8bd, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.068927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.137400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 921/1829] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:18 2022] PUT /identity/v3/projects/e7bd4f845aaa4fb2939e5cfe6007a155/users/5e1d47b9708f453ba901a0f3fdc2b8bd/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:18.148936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.149231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.149534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.176848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] MFA Rules not processed for user `5e1d47b9708f453ba901a0f3fdc2b8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:18.178062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:18.241743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 909/1830] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:18.246875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.260745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:18.309788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4c64-04fe-49a8-ad00-22862609252a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.314386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.315038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.315323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.315623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.316316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.318207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.413747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 922/1831] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:18.418161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.429125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c89d7-cef9-4249-a74b-8529b6fa74fe None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.501570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.502333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.502716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.503080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.504356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.506223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.595436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 910/1832] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:18 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:18.596722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.607573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5ea56-6bbb-4a08-937f-59d679d7a322 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.612540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.613281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.613631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.614000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.614731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.616496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.630608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 923/1833] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:18.632655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.643600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ea36-b274-4ad2-95e5-8ce66a4ef53b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.648115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.648777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.649061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.649333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.650052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.652478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec377a-1613-4d1d-8743-e2170217e5be admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.662636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 911/1834] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:18.667147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:18.677105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881760d6-86f3-4843-bf5c-e5b4f775e622 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:18.682671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:18.683589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.683877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.684157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] PATH_INFO: `/v3/projects/d9839f3a55ea497fab51355e0afa943c/users/f48427fdb0404cdfa78e39ce102d3362/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.700134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9839f3a55ea497fab51355e0afa943c, user_id=f48427fdb0404cdfa78e39ce102d3362, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:18.702853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:18.809220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 924/1835] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:18 2022] PUT /identity/v3/projects/d9839f3a55ea497fab51355e0afa943c/users/f48427fdb0404cdfa78e39ce102d3362/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:18.819131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:18.819428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:18.819738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:18.847131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] MFA Rules not processed for user `f48427fdb0404cdfa78e39ce102d3362`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:18.848474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:18.890509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:18.946534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 912/1836] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:18.947987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:19.004734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b91f-1c17-4652-af34-e6beb3d115f4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:19.009579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:19.011001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:19.011292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:19.011610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:19.012407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:19.014472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:19.379449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 925/1837] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:19.389976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:19.396259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fafd6-3efc-4cbc-b3b8-a526aea0a4d0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:19.462615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:19.464076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:19.464354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:19.464632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:19.465332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:19.467274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:19.833198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 913/1838] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:19 2022] POST /identity/v3/users => generated 299 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:19.843156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:19.854428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27bd7-c632-4c8b-b3d1-85f2e958f5b5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:19.859790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:19.861752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:19.861752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:19.861752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:19.861752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:19.863422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:19.876473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 926/1839] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:19.880828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:19.891735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866b867-a247-4c34-96e9-40a9caf162df admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:19.896214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:19.897100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:19.897382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:19.897653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] PATH_INFO: `/v3/projects/49348631eeed4362a638f953a8844359/users/4f5b5f62c37345038016f4f4d162c723/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:19.916605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49348631eeed4362a638f953a8844359, user_id=4f5b5f62c37345038016f4f4d162c723, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:19.919218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:20.004841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 914/1840] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:19 2022] PUT /identity/v3/projects/49348631eeed4362a638f953a8844359/users/4f5b5f62c37345038016f4f4d162c723/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:20.008838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:20.019619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e78c-197f-44fe-924a-43c36720595b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:20.053370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:20.085280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:20.085280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:20.085280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:20.085280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:20.085650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:20.085650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cc561-7ef8-4b78-83d7-69cdd1c4d985 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:20.091195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 927/1841] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:20.095396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:20.107966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea748-5775-4cbd-802d-f6bc760dcfa0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:20.112802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:20.114453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:20.114453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:20.114769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] PATH_INFO: `/v3/projects/49348631eeed4362a638f953a8844359/users/4f5b5f62c37345038016f4f4d162c723/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:20.116877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49348631eeed4362a638f953a8844359, user_id=4f5b5f62c37345038016f4f4d162c723, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:20.120601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:20.131299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 915/1842] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:20 2022] PUT /identity/v3/projects/49348631eeed4362a638f953a8844359/users/4f5b5f62c37345038016f4f4d162c723/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:20.148569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:20.148807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:20.149091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:20.177097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] MFA Rules not processed for user `4f5b5f62c37345038016f4f4d162c723`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:20.178478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:20.249773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 928/1843] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:20.260446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:20.262242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:20.319238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81fe10-e28f-4e6d-ab42-e8eb3bac514b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:20.322897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:20.323553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:20.323867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:20.324142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:20.333172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:20.334586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:20.344366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 916/1844] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:21.571923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:21.573624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:21.585459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddeba0-7b7d-4115-81da-bb79d7882f3a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:21.589959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:21.590711 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:21.591143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:21.591321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:21.651422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:21.652901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:21.661886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 929/1845] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:27.027872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:27.037194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a616f77-febd-4efa-a4d4-757dd40d345e service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:27.042207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:27.043079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:27.043597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:27.044048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:27.077439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:27.108174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:27.109895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb8eb5-98b6-4046-8aca-5869f141bd19 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:27.127891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 917/1846] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:31.657706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=74 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:31.879210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:31.954731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575656-ceb4-4fb0-b481-4727560c0323 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:31.959239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:31.960136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:31.960416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:31.960698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] PATH_INFO: `/v3/users/5e1d47b9708f453ba901a0f3fdc2b8bd` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:31.962522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1d47b9708f453ba901a0f3fdc2b8bd)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:31.964582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:32.116132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1d47b9708f453ba901a0f3fdc2b8bd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.116779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1d47b9708f453ba901a0f3fdc2b8bd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.171211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1d47b9708f453ba901a0f3fdc2b8bd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.184162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1d47b9708f453ba901a0f3fdc2b8bd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.191005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1d47b9708f453ba901a0f3fdc2b8bd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.197405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 930/1847] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:31 2022] DELETE /identity/v3/users/5e1d47b9708f453ba901a0f3fdc2b8bd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:32.201927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:32.202442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:32.202543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:32.220246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:32.221465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:32.282574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 918/1848] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:32.292452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:32.293929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:32.353632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55cf1-3e28-4750-b1f5-f7f90552e2c5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:32.357460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:32.358118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:32.358407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:32.358691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:32.370418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:32.372124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:32.381947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 931/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:32.829851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:32.831280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:32.846973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c79b8-d7e2-49b8-822f-714d762df820 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:32.853012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:32.853884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:32.854126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:32.854478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] PATH_INFO: `/v3/projects/e7bd4f845aaa4fb2939e5cfe6007a155` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:32.855752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bd4f845aaa4fb2939e5cfe6007a155)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:32.857742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:32.957773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bd4f845aaa4fb2939e5cfe6007a155', 'request_id': 'req-b14f5426-e2d0-44d2-8593-eae21dd8521e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:32.964868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bd4f845aaa4fb2939e5cfe6007a155', 'request_id': 'req-b14f5426-e2d0-44d2-8593-eae21dd8521e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.072050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bd4f845aaa4fb2939e5cfe6007a155', 'request_id': 'req-b14f5426-e2d0-44d2-8593-eae21dd8521e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.084605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] The token cache is being invalidate because project e7bd4f845aaa4fb2939e5cfe6007a155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:33.085000 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.085964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.088344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 919/1850] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:32 2022] DELETE /identity/v3/projects/e7bd4f845aaa4fb2939e5cfe6007a155 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:33.092249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:33.104357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c123-ec7b-49c1-8600-0b779523221f service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:33.124530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:33.171665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:33.171665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:33.171665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:33.171665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] PATH_INFO: `/v3/users/f48427fdb0404cdfa78e39ce102d3362` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:33.172056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48427fdb0404cdfa78e39ce102d3362)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:33.172056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:33.398111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48427fdb0404cdfa78e39ce102d3362'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.398776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48427fdb0404cdfa78e39ce102d3362'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.491169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48427fdb0404cdfa78e39ce102d3362'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.508981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48427fdb0404cdfa78e39ce102d3362'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.517434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48427fdb0404cdfa78e39ce102d3362'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:33.526165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 932/1851] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:33 2022] DELETE /identity/v3/users/f48427fdb0404cdfa78e39ce102d3362 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:34.154894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:34.157035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:34.173118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f5426-e2d0-44d2-8593-eae21dd8521e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:34.237111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:34.245766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:34.246792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:34.247145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:34.247489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] PATH_INFO: `/v3/projects/d9839f3a55ea497fab51355e0afa943c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:34.248794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9839f3a55ea497fab51355e0afa943c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:34.250821 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:34.394023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9839f3a55ea497fab51355e0afa943c', 'request_id': 'req-ff05aad0-b1eb-4de2-8d9d-404630b09465'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.401642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9839f3a55ea497fab51355e0afa943c', 'request_id': 'req-ff05aad0-b1eb-4de2-8d9d-404630b09465'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.489592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9839f3a55ea497fab51355e0afa943c', 'request_id': 'req-ff05aad0-b1eb-4de2-8d9d-404630b09465'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.501829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] The token cache is being invalidate because project d9839f3a55ea497fab51355e0afa943c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:34.502125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.502770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.504349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 920/1852] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:34 2022] DELETE /identity/v3/projects/d9839f3a55ea497fab51355e0afa943c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:34.508372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:34.510040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:34.523016 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26732a7-48a2-439f-8d1b-5abc43ae3ad5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:34.581895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:34.582847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:34.583131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:34.583408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] PATH_INFO: `/v3/users/4f5b5f62c37345038016f4f4d162c723` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:34.584641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5b5f62c37345038016f4f4d162c723)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:34.587183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:34.796703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:34.799230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5b5f62c37345038016f4f4d162c723'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.799982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5b5f62c37345038016f4f4d162c723'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.896802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5b5f62c37345038016f4f4d162c723'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.910507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5b5f62c37345038016f4f4d162c723'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.917479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-56112151-e04b-46d6-a29c-5ca45e772949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5b5f62c37345038016f4f4d162c723'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:34.923687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 933/1853] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:34 2022] DELETE /identity/v3/users/4f5b5f62c37345038016f4f4d162c723 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:35.397904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:35.400165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:35.421148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05aad0-b1eb-4de2-8d9d-404630b09465 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:35.491673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:35.493297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:35.493558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:35.495409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] PATH_INFO: `/v3/projects/49348631eeed4362a638f953a8844359` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:35.505136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49348631eeed4362a638f953a8844359)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:35.507190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:35.652600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49348631eeed4362a638f953a8844359', 'request_id': 'req-f7476ef1-f3c7-4b20-913c-a8ef01457663'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:35.659068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49348631eeed4362a638f953a8844359', 'request_id': 'req-f7476ef1-f3c7-4b20-913c-a8ef01457663'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:35.736742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49348631eeed4362a638f953a8844359', 'request_id': 'req-f7476ef1-f3c7-4b20-913c-a8ef01457663'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:35.748328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] The token cache is being invalidate because project 49348631eeed4362a638f953a8844359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:35.748641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:35.749255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f7476ef1-f3c7-4b20-913c-a8ef01457663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:35.750799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 921/1854] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:35 2022] DELETE /identity/v3/projects/49348631eeed4362a638f953a8844359 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:35.756875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:35.757386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:35.757480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:35.776964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:35.778192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:35.864501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 934/1855] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:35.866759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:35.867278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:35.867851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:35.908194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:35.917016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:35.931187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 922/1856] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:35.935684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:35.948413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6dac-f75c-46b2-95c4-dfd7e2b530ff None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:35.955272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:35.955977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:35.956265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:35.956594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:35.957449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:35.957847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:35.960223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:35.984120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 935/1857] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:09:35.988577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.002388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78214035-3ec0-4dfd-bd6e-4d25f5a30329 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.014225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.015387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.016128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.016599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.017570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.019860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.025611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:36.130668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 923/1858] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:35 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:36.135749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.146001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a6565-bf5f-4a64-bfcb-b13a0dc01eae admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.205858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.206523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.206806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.207082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.207800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.210049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.298067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 936/1859] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:36 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:36.300280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.311513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a6e7-1253-488e-bfe5-42a6bc178afc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.316730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.317641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.318079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.318432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.319174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.321695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.334247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 924/1860] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:36.339159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.349464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e775d1-4a66-4ec3-b273-b913cc45c3f8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.354668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.355334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.355646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.355935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.356653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.358327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791ce6b-252a-4a62-bba4-fb81086333cb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.373390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 937/1861] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:36.376348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.387269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3c888-0aa7-4916-b74b-20ae2c4a0d55 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.392238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.396409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.396409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.396409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] PATH_INFO: `/v3/projects/a45fd9abac95450f8dedf8836aa6cccb/users/9c07d0c5f4f54a649c1fbf7ebe483c20/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.409965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45fd9abac95450f8dedf8836aa6cccb, user_id=9c07d0c5f4f54a649c1fbf7ebe483c20, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.412647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.505484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 925/1862] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:36 2022] PUT /identity/v3/projects/a45fd9abac95450f8dedf8836aa6cccb/users/9c07d0c5f4f54a649c1fbf7ebe483c20/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:36.517245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.517634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.517981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.545982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] MFA Rules not processed for user `9c07d0c5f4f54a649c1fbf7ebe483c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:36.547183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:36.561161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:36.613113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 938/1863] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:36.618272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.681781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f22a4-699e-416f-89e7-8fe2d5ef5c80 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.686656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.687329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.687653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.687936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.688639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.690606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:36.772769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 926/1864] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:36 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:36.776969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:36.788158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d8f11-96ad-4deb-8e8a-3172d77bb3f6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:36.846234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:36.846912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:36.847198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:36.847476 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:36.848270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:36.850222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.016714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 939/1865] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:36 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:37.019710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.031059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5dcf5-ff22-43c5-8e9c-8a4414acb78f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.035832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486246-251a-4d03-911a-68518583881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.037828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486246-251a-4d03-911a-68518583881d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.037828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486246-251a-4d03-911a-68518583881d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.037828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486246-251a-4d03-911a-68518583881d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.037828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0486246-251a-4d03-911a-68518583881d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.039409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0486246-251a-4d03-911a-68518583881d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.051311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 927/1866] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:37.056171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.066881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddf06-e9e2-4619-a205-6a0e6d583d6a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.072137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.072928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.073215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.073494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] PATH_INFO: `/v3/projects/1a1338bd1ec9423189f432bb6233fd39/users/52a4f902346e4db6b99e333933f4602c/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.090214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1338bd1ec9423189f432bb6233fd39, user_id=52a4f902346e4db6b99e333933f4602c, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.092925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.251421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 940/1867] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:37 2022] PUT /identity/v3/projects/1a1338bd1ec9423189f432bb6233fd39/users/52a4f902346e4db6b99e333933f4602c/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:37.255668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486246-251a-4d03-911a-68518583881d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.266999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486246-251a-4d03-911a-68518583881d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.330930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.331750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.331932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.332244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.332969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.334581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6b10-0943-40c2-ac4b-d29f6a067ab7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.346723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 928/1868] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:37.351019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.363203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672317e3-be16-4efe-a79c-eefee5f6ea01 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.369675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.370573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.373956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.373956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] PATH_INFO: `/v3/projects/1a1338bd1ec9423189f432bb6233fd39/users/52a4f902346e4db6b99e333933f4602c/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.373956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1338bd1ec9423189f432bb6233fd39, user_id=52a4f902346e4db6b99e333933f4602c, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.379572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.392385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 941/1869] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:37 2022] PUT /identity/v3/projects/1a1338bd1ec9423189f432bb6233fd39/users/52a4f902346e4db6b99e333933f4602c/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:37.404640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b244-664f-4b7c-b7ba-13521634dd02 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.404948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b244-664f-4b7c-b7ba-13521634dd02 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.405236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b244-664f-4b7c-b7ba-13521634dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.437054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c653b244-664f-4b7c-b7ba-13521634dd02 None None] MFA Rules not processed for user `52a4f902346e4db6b99e333933f4602c`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:37.438289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c653b244-664f-4b7c-b7ba-13521634dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.449397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:37.511564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 929/1870] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:37.523627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.528745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.593189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd886e0-ba5e-4de5-817c-ed9d6f01d7bb admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.597056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.597715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.598003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.598284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.608661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.610089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18521d-8423-42b3-92c2-0ff2462d150e service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.620445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 942/1871] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:37.739920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.740567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.741423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.743992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 930/1872] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:09:37.757366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.757823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.758294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.778416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:37.779666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.785673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:37.858718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.860639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.861018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 943/1873] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:37.877949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e323dd2-2ce9-4b10-b3e0-c2dbc3256819 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.881801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.882483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.882774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.883625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.899421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.900966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.927333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a62bb-6d59-4641-986e-af912760bf04 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:37.935760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:37.945230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:37.945230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:37.945230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:37.947552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.949245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.958438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:37.959714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 944/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:37.959985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:37.968225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:37.969640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:37.972555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 931/1875] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:38.060272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7631-f355-494a-8be3-a117356f29a0 service placement] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:38.065580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:38.067082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.067420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.067804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] PATH_INFO: `/v3/users/6c12284a3fb845a5b6c073fcb98913ee` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.069491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c12284a3fb845a5b6c073fcb98913ee)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:38.073126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:38.190819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:38.192480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.208308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de296a9-1674-4646-9edb-eed6e7460329 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:38.213654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:38.214538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.214825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.215102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] PATH_INFO: `/v3/users/0a387c6a414c45f68fd92e3db9cd1e3e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.216316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a387c6a414c45f68fd92e3db9cd1e3e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:38.218230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:38.283693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c12284a3fb845a5b6c073fcb98913ee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.284898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c12284a3fb845a5b6c073fcb98913ee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.364861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c12284a3fb845a5b6c073fcb98913ee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.381766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c12284a3fb845a5b6c073fcb98913ee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.395396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-af07b3b7-f2ce-4062-90b3-f2db718f871b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c12284a3fb845a5b6c073fcb98913ee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.403267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 945/1876] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:37 2022] DELETE /identity/v3/users/6c12284a3fb845a5b6c073fcb98913ee => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:38.407958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a387c6a414c45f68fd92e3db9cd1e3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.408607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a387c6a414c45f68fd92e3db9cd1e3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.417359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a387c6a414c45f68fd92e3db9cd1e3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.432963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a387c6a414c45f68fd92e3db9cd1e3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.496635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a387c6a414c45f68fd92e3db9cd1e3e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.505081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 932/1877] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:38 2022] DELETE /identity/v3/users/0a387c6a414c45f68fd92e3db9cd1e3e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:38.509929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e5df-278f-46e0-add5-dff3c0782205 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.510284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e5df-278f-46e0-add5-dff3c0782205 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.510980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e5df-278f-46e0-add5-dff3c0782205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.531337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-70b1e5df-278f-46e0-add5-dff3c0782205 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:38.532951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-70b1e5df-278f-46e0-add5-dff3c0782205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.554761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:38.611700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 946/1878] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:38.621981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:38.623622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.645550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:38.694172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34fa5-2780-4bec-baf7-0176ce0be163 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:38.697429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.697963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.698492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.699129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:38.699949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.700360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.700650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.701237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 947/1879] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:09:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 13:09:38.710133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:38.713494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.716833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:38.719076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d068c39-05cb-466e-b5c5-5b5913876462 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:38.749556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8192-cebf-453f-afd6-7a681227b19f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:38.754108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 933/1880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:38.755474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.756207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:38.756747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.757471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.757666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.759089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.759760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] PATH_INFO: `/v3/projects/9e72dd6caaa243f9ac9989f766976e30` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.762327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e72dd6caaa243f9ac9989f766976e30)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:38.771430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:38.785281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] MFA Rules not processed for user `1e9e09994be6462ca1d4f6be27d7a604`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:38.786747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.874309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 934/1881] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:38.886398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:38.887950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:38.904959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8244b-111a-49e7-b612-6ae9f19cfede None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:38.923358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e72dd6caaa243f9ac9989f766976e30', 'request_id': 'req-b41f8223-1364-46bf-bc43-fac8553a3cda'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:38.982495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:38.983247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:38.983633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:38.983993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:38.994389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:38.996172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521025bb-d6e7-46c3-ad1a-9dabdadcb663 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.005865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e72dd6caaa243f9ac9989f766976e30', 'request_id': 'req-b41f8223-1364-46bf-bc43-fac8553a3cda'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.007507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 935/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:39.014853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e72dd6caaa243f9ac9989f766976e30', 'request_id': 'req-b41f8223-1364-46bf-bc43-fac8553a3cda'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.029986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] The token cache is being invalidate because project 9e72dd6caaa243f9ac9989f766976e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:39.030466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.031336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b41f8223-1364-46bf-bc43-fac8553a3cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.036840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 948/1883] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:38 2022] DELETE /identity/v3/projects/9e72dd6caaa243f9ac9989f766976e30 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:39.040855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.041216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.041507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.063423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:39.065606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.148739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 936/1884] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:39.157520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec51-23b1-495f-ab31-6972035066da None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.157820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec51-23b1-495f-ab31-6972035066da None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.158106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec51-23b1-495f-ab31-6972035066da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.177922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-13ccec51-23b1-495f-ab31-6972035066da None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:39.179164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13ccec51-23b1-495f-ab31-6972035066da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.188893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 949/1885] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:39.193725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.205117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965573a-ca70-4c50-90b3-584967be2338 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.210798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.211696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.212368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.212603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.213347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:39.213662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.215312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.228138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 937/1886] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:39.232624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccec51-23b1-495f-ab31-6972035066da None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.245895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccec51-23b1-495f-ab31-6972035066da None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.250810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.251488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.251858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.252143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.252859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.254767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.298437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.300431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.317813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92a8d-076e-4945-a1b8-98f6b0bb7bfd admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.323913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.324895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.325181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.325504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] PATH_INFO: `/v3/projects/14d3e44f18bb40f5a0cf56a8db73a90e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.327659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d3e44f18bb40f5a0cf56a8db73a90e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.329715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.386057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 950/1887] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:39 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:39.387173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.459088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be41dd5-82a1-4748-a500-649e18d52538 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.471910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d3e44f18bb40f5a0cf56a8db73a90e', 'request_id': 'req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.484047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d3e44f18bb40f5a0cf56a8db73a90e', 'request_id': 'req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.522212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.522906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.523379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.524818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.524818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.526590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.575626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d3e44f18bb40f5a0cf56a8db73a90e', 'request_id': 'req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.587791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] The token cache is being invalidate because project 14d3e44f18bb40f5a0cf56a8db73a90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:39.588081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.588786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.590421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 938/1888] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:39 2022] DELETE /identity/v3/projects/14d3e44f18bb40f5a0cf56a8db73a90e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:39.594252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.596306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.609519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 951/1889] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:39 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:39.613541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1b3c8-7ec2-4041-967d-2cb5968332f9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.613728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.615784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.619396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.620796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.621095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.621381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] PATH_INFO: `/v3/users/1ae02ee3dbce4dd187bc488b2179cfd3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.622967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae02ee3dbce4dd187bc488b2179cfd3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.625342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.631344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafb48f-0b19-4ed8-a61b-17d9be838bb7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.642197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.642922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.643213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.643670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.644412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.646028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.658595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 952/1890] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:39.663732 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.674771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411c63-6ac7-44e6-8620-6d20e38afd39 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.680730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.681454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.681737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.682405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.682786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.684456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.695815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 953/1891] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:39.696483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.702162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.712787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257d40-2e3a-4d17-b982-9db78be4b6f6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:39.717558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:39.718573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:39.718857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:39.719128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] PATH_INFO: `/v3/users/1f3c233944274ccc9a08121eb0c0884b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:39.720369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3c233944274ccc9a08121eb0c0884b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:39.722797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:39.733134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:39.822911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae02ee3dbce4dd187bc488b2179cfd3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.823702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae02ee3dbce4dd187bc488b2179cfd3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.833711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae02ee3dbce4dd187bc488b2179cfd3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.847489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae02ee3dbce4dd187bc488b2179cfd3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.895327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:39.923691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae02ee3dbce4dd187bc488b2179cfd3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.931521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 939/1892] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:39 2022] DELETE /identity/v3/users/1ae02ee3dbce4dd187bc488b2179cfd3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:39.932545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:39.934501 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:39.945228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3c233944274ccc9a08121eb0c0884b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:39.946301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3c233944274ccc9a08121eb0c0884b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.008404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a8f5f-ad0d-44ad-812b-31aae4868b34 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.014768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.015720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.016008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.016329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] PATH_INFO: `/v3/projects/e6209d9e18bd4f89b7ecf0f135ebfd2b/users/4cbb28bd16a244a7b41ba70581ecb785/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.022818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3c233944274ccc9a08121eb0c0884b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.035974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6209d9e18bd4f89b7ecf0f135ebfd2b, user_id=4cbb28bd16a244a7b41ba70581ecb785, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.040079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3c233944274ccc9a08121eb0c0884b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.041582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.054191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e76cc89e-dfb7-425b-8462-c4c4324ae0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3c233944274ccc9a08121eb0c0884b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.060690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 954/1893] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:39 2022] DELETE /identity/v3/users/1f3c233944274ccc9a08121eb0c0884b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:40.136500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 940/1894] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:39 2022] PUT /identity/v3/projects/e6209d9e18bd4f89b7ecf0f135ebfd2b/users/4cbb28bd16a244a7b41ba70581ecb785/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:40.146894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.147191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.147476 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.179097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] MFA Rules not processed for user `4cbb28bd16a244a7b41ba70581ecb785`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:40.180854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.245759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:40.252743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 955/1895] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:40.257325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.260591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.331784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817255-6cf2-456b-b3fa-05c45f02e001 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.336811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.337512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.337806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.338297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.339196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.341205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.448262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 941/1896] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:40 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:40.457202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.457355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.458952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.470215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55086-6781-435f-91c9-71c97951e9ec None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.540580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.541250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.541532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.541672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d2df-8c09-41d9-8b3e-d91a3f57e7fa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.541804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.542592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.544542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.547461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.548426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.548781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.549094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] PATH_INFO: `/v3/projects/84eb3d2cfb84485090ae562025f6b555` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.550338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eb3d2cfb84485090ae562025f6b555)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.552553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.622633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 956/1897] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:40 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:40.623651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.625206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.634843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:40.638623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20aa99-8bc0-4887-8e2b-5510d8ed58ae admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.652107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eb3d2cfb84485090ae562025f6b555', 'request_id': 'req-80d86edc-2a38-45e2-a40e-d76270407397'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.658271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eb3d2cfb84485090ae562025f6b555', 'request_id': 'req-80d86edc-2a38-45e2-a40e-d76270407397'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.695720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.696592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.696904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.697183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] PATH_INFO: `/v3/projects/22c0df8bdb0e419eb8d2f2efc056d706` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.698368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c0df8bdb0e419eb8d2f2efc056d706)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.700304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.722941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eb3d2cfb84485090ae562025f6b555', 'request_id': 'req-80d86edc-2a38-45e2-a40e-d76270407397'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.738188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] The token cache is being invalidate because project 84eb3d2cfb84485090ae562025f6b555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:40.738606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.739290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.740878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 942/1898] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:40 2022] DELETE /identity/v3/projects/84eb3d2cfb84485090ae562025f6b555 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:40.741642 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.743865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.756620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86edc-2a38-45e2-a40e-d76270407397 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.762046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.762787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.763066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.763356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.764410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.766022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c007-eb43-4b63-b591-131b16e14dcd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.776432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 943/1899] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:40.777689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.777985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.778269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.796716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:40.798076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.813873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c0df8bdb0e419eb8d2f2efc056d706', 'request_id': 'req-2ac81e5d-0c93-424e-9416-d9d80168404e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.860942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 944/1900] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:40.861794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.871247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c0fd6-f0d3-4dfe-b6fb-8f0263d9d037 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.876390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.877286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.877627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.877909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] PATH_INFO: `/v3/projects/a3cf363194494387b2698a903e0ce55b/users/67dfd944211940ed9dab5dfd4ee19387/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.893496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cf363194494387b2698a903e0ce55b, user_id=67dfd944211940ed9dab5dfd4ee19387, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.896184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.896955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c0df8bdb0e419eb8d2f2efc056d706', 'request_id': 'req-2ac81e5d-0c93-424e-9416-d9d80168404e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.906086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c0df8bdb0e419eb8d2f2efc056d706', 'request_id': 'req-2ac81e5d-0c93-424e-9416-d9d80168404e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.924558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] The token cache is being invalidate because project 22c0df8bdb0e419eb8d2f2efc056d706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:40.925054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.926370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2ac81e5d-0c93-424e-9416-d9d80168404e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:40.928060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 957/1901] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:40 2022] DELETE /identity/v3/projects/22c0df8bdb0e419eb8d2f2efc056d706 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:40.929304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.929599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.929883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.950296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:40.951493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.959349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 958/1902] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:40.960206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:40.962040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:40.973138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8818-9a24-43ff-9189-23da54874e05 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:40.977967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:40.978810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:40.979100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:40.979376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] PATH_INFO: `/v3/users/0b31b194a71243e996cf1dc0ec979810` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:40.980599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b31b194a71243e996cf1dc0ec979810)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:40.982523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:40.988187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 945/1903] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:40 2022] PUT /identity/v3/projects/a3cf363194494387b2698a903e0ce55b/users/67dfd944211940ed9dab5dfd4ee19387/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:40.989058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.051922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5090-76ff-4205-8bdf-764aeb9ceabc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.056831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.057490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.057777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.058055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.058770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:41.059082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.060711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.072762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 946/1904] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:41.073953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.080258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.095078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a86e6-e159-4849-aeac-08f8bf2d7df9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.099961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.100657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.100944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.101228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.102062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.103824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.113651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 947/1905] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:41.114485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.124336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec25360-1a51-42e4-9958-ba20ccb1eb57 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.126582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:41.130708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.131354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.131709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.131994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.132730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.135761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.189362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b31b194a71243e996cf1dc0ec979810'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.189949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b31b194a71243e996cf1dc0ec979810'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.201184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 948/1906] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:41 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:41.202795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.204567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.267056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889784bd-28a8-488f-a133-03abf0ed92f3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.267725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b31b194a71243e996cf1dc0ec979810'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.271939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.272849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.273143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.273460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] PATH_INFO: `/v3/projects/a3cf363194494387b2698a903e0ce55b/users/67dfd944211940ed9dab5dfd4ee19387/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.275646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cf363194494387b2698a903e0ce55b, user_id=67dfd944211940ed9dab5dfd4ee19387, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.278373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.281324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b31b194a71243e996cf1dc0ec979810'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.288377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67eaf089-8df7-4936-b886-e77a7843d9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b31b194a71243e996cf1dc0ec979810'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.289921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 949/1907] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:41 2022] PUT /identity/v3/projects/a3cf363194494387b2698a903e0ce55b/users/67dfd944211940ed9dab5dfd4ee19387/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:41.294699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 959/1908] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:40 2022] DELETE /identity/v3/users/0b31b194a71243e996cf1dc0ec979810 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:41.296388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.299425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.301070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.301367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.301643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.319353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:41.332985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] MFA Rules not processed for user `67dfd944211940ed9dab5dfd4ee19387`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:41.334217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.377330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ac3d-5711-45f4-a585-a2805d041717 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.410909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 960/1909] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:41.423358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.424958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.444321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.444321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.444598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.444843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.445531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.447568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.468214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:41.487123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e0081-f7dc-432f-b2ba-f8f7e7975524 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.490725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.491491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.491817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.492634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.501831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.503247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.513346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 961/1910] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:41.566631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 950/1911] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:41 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:41.567854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.579191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15073d-45d0-45e4-9ac2-cd0578f988a4 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.584086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.587977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.587977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.587977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.587977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.588327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.598156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 962/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:41.602683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.613849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.614424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada8d71-9253-4f98-825a-f45fa8b282c7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.615627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.624464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.627159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.627498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.629259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.629259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.631144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.646909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 951/1913] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:41.653157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1c52-dddd-4e57-ba9b-8b366d37387c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.654907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.656135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.657007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.657292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.657564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] PATH_INFO: `/v3/projects/0f3e61b037b34478956236c9e7c3730a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.658750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3e61b037b34478956236c9e7c3730a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.660920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.666437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c1000-4e1d-42f7-a33d-797987b29107 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.671451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.672565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.672925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.673301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] PATH_INFO: `/v3/projects/f0d472180137463c9b24967ac9ea3235/users/31330569c9b14b7585905ce988dac053/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.697207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d472180137463c9b24967ac9ea3235, user_id=31330569c9b14b7585905ce988dac053, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:41.699393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:41.740307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:41.805754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 952/1914] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:41 2022] PUT /identity/v3/projects/f0d472180137463c9b24967ac9ea3235/users/31330569c9b14b7585905ce988dac053/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:41.806681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:41.815947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3e61b037b34478956236c9e7c3730a', 'request_id': 'req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.864765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712f85-fa3c-40cf-8bea-5282d4935911 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:41.896821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3e61b037b34478956236c9e7c3730a', 'request_id': 'req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.904001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3e61b037b34478956236c9e7c3730a', 'request_id': 'req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.914908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:41.915775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.916067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.916348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.917267 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] The token cache is being invalidate because project 0f3e61b037b34478956236c9e7c3730a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:41.917663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.918258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c1f8c066-7f9b-4002-bf00-b4ba9cdcbdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:41.918578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:41.920077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 963/1915] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:41 2022] DELETE /identity/v3/projects/0f3e61b037b34478956236c9e7c3730a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:41.921256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:41.921552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:41.921834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:41.957484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] MFA Rules not processed for user `31330569c9b14b7585905ce988dac053`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:41.957484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.000715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:42.009471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.009471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa386a-d6b5-439c-9d28-8969ba82f6ed service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.017558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 953/1916] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:42.018890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd209e9-f20e-47d8-b9a8-f84cb4ba602f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.019190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd209e9-f20e-47d8-b9a8-f84cb4ba602f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.019475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd209e9-f20e-47d8-b9a8-f84cb4ba602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.044524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3dd209e9-f20e-47d8-b9a8-f84cb4ba602f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:42.045170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3dd209e9-f20e-47d8-b9a8-f84cb4ba602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.048281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 964/1917] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:42.052229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.053726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.130338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd633-063d-44ed-993f-64b4c91e9050 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.132449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 954/1918] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:42.135952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.136628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.136944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.137223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.137922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.140412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.140591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.140890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.141077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.161280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:42.162632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.171622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 955/1919] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:42.175729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.186772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dbf44-9f72-4621-9027-578a7f1240a5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.192277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.192411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.192709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.192986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.193716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:42.194260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.196835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.212695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 956/1920] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:09:42.213598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.223272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352ae83-632a-40ce-9cc1-76ca322579d7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.228156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.228831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.229122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.229401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.230093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.232089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.250705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 965/1921] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:42.254591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.320892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c6498-23dd-40fa-bf34-bc3a6b46fe6e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.326073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.326827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.330787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.330787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.330787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.330787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.331072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 957/1922] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:42.337388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.404720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 966/1923] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:42.405155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b512b-e205-48c1-a3ef-5318b41a1fce admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.409188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.411193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.414751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.415380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.416102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.416988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.419055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.420281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd9c4-fe7c-46d0-8584-648af087b1aa admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.425226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.425946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.426231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.432158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.432158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.432158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.439066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 967/1924] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:42.443070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.452872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34337f-1dd6-4ed0-bf5a-625b7409a32e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.457442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.458291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.458560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.458832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] PATH_INFO: `/v3/projects/862001af9de844b6a83ba04376c7b77e/users/8b40bc036d9c4ee8be509c8abf7cae85/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.474377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=862001af9de844b6a83ba04376c7b77e, user_id=8b40bc036d9c4ee8be509c8abf7cae85, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.477303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.490754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:42.507116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 958/1925] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:42.508676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.520172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528130a-0c58-41a4-8c7d-bcf9ca30dd0e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.526568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.527271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.527652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.527943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.528668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.530256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.540478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 959/1926] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:42.544410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.553830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e75846-2a89-4db0-9f6e-a1e9e0e55f15 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.559089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 968/1927] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:42 2022] PUT /identity/v3/projects/862001af9de844b6a83ba04376c7b77e/users/8b40bc036d9c4ee8be509c8abf7cae85/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:42.565574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.605414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:42.617235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.618177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.618496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.618782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.619514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.621296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.629194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314c6f-8d66-4cc1-a8db-72068dae5e5e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.631720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 960/1928] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:42.635025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.635914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.639596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.639596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.639760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.639838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.639838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.647835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fdf5c-6c72-42e7-a06b-19641474d390 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.653450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 969/1929] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:42.655255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.657382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.658345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.658638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.658921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] PATH_INFO: `/v3/projects/ebbcf9e82b6a43eca627895927a01796/users/ae9352b2e60f406981588b763d07ad0c/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.665408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d754cd-3741-457a-893d-ed7de1449052 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.670725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.671642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.671959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.672444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] PATH_INFO: `/v3/projects/862001af9de844b6a83ba04376c7b77e/users/8b40bc036d9c4ee8be509c8abf7cae85/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.674486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862001af9de844b6a83ba04376c7b77e, user_id=8b40bc036d9c4ee8be509c8abf7cae85, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.680039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbcf9e82b6a43eca627895927a01796, user_id=ae9352b2e60f406981588b763d07ad0c, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.680129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef276ca-e5bf-40de-8e4d-996e2cce47b9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.680206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eda550-11aa-4f48-95da-379ebd9aeab8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:42.689442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 970/1930] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:42 2022] PUT /identity/v3/projects/862001af9de844b6a83ba04376c7b77e/users/8b40bc036d9c4ee8be509c8abf7cae85/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:42.700824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.701134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.703034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.738416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] MFA Rules not processed for user `8b40bc036d9c4ee8be509c8abf7cae85`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:42.738416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.764119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 961/1931] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:42 2022] PUT /identity/v3/projects/ebbcf9e82b6a43eca627895927a01796/users/ae9352b2e60f406981588b763d07ad0c/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:42.774463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.774885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.775171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.800967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] MFA Rules not processed for user `ae9352b2e60f406981588b763d07ad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:42.802168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.806289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 971/1932] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:42.816941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:42.818362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:42.872505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 962/1933] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:42.881430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed11b9-fb1f-49b8-9519-4c9461bd6595 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:42.932800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:42.933615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:42.933906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:42.934186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:42.988142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:42.993022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:42.994391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:43.003745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 972/1934] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:43.018269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:43.019892 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:43.032367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958b51-1c4a-4a26-8664-029e721fb49a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:43.036014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:43.036665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:43.036952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:43.037260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:43.043085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:43.046112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:43.047570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bb57e-0902-4b1b-8365-e6418a39c7ff service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:43.057149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 963/1935] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:43.077858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:43.149472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f48fa-0d1e-4709-92cc-4fba25d677e5 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:43.154069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:43.154945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:43.155226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:43.155666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] PATH_INFO: `/v3/users/ae9352b2e60f406981588b763d07ad0c` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:43.156879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9352b2e60f406981588b763d07ad0c)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:43.158841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:43.356137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9352b2e60f406981588b763d07ad0c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:43.356786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9352b2e60f406981588b763d07ad0c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:43.416345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:43.438706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9352b2e60f406981588b763d07ad0c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:43.456537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9352b2e60f406981588b763d07ad0c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:43.464676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9352b2e60f406981588b763d07ad0c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:43.471302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 973/1936] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:43 2022] DELETE /identity/v3/users/ae9352b2e60f406981588b763d07ad0c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:43.476246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:43.476948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:43.478567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:43.498315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:43.499472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:43.562472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 964/1937] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:43.572927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:43.574484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:43.639470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3177-68e2-4bb4-8c05-d58d1a4357a4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:43.643205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:43.643893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:43.644179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:43.644456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:43.653858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:43.655311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ee88b-c1fd-47c8-9fe6-ccad82843cbe service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:43.665037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 974/1938] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:44.162879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:44.165120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:44.178478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88edf-d80a-46e4-aec3-225800473815 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:44.183657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:44.189029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.189029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.189029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] PATH_INFO: `/v3/projects/ebbcf9e82b6a43eca627895927a01796` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.189029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbcf9e82b6a43eca627895927a01796)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:44.189029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:44.339269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbcf9e82b6a43eca627895927a01796', 'request_id': 'req-032696e7-f232-4970-b756-4e44574944d7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:44.346505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbcf9e82b6a43eca627895927a01796', 'request_id': 'req-032696e7-f232-4970-b756-4e44574944d7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:44.434179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbcf9e82b6a43eca627895927a01796', 'request_id': 'req-032696e7-f232-4970-b756-4e44574944d7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:44.448398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] The token cache is being invalidate because project ebbcf9e82b6a43eca627895927a01796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:44.448774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:44.449503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-032696e7-f232-4970-b756-4e44574944d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:44.451595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 965/1939] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:44 2022] DELETE /identity/v3/projects/ebbcf9e82b6a43eca627895927a01796 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:44.456091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.456572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.456655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.495893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:44.497291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:44.532491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:44.563936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 975/1940] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:44.578390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.578688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.578975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.597840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:44.599183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:44.607930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 966/1941] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:44.612122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:44.623700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a2221-0533-448c-be84-834dd825ec96 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:44.628698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:44.629379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.629665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.629956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.630685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:44.630992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:44.632702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:44.645626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 976/1942] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:44.657523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:44.662101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:44.668562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11765-a01b-488f-8ff1-5318b1c00dc3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:44.673483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:44.674152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.674433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.674763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.675455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:44.677410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:44.793819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 967/1943] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:44 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:44.797992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:44.808652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10080e-c6d6-4f39-b2ba-d930bd20a232 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:44.835968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:44.841549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:44.866927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:44.868257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.868503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.868778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.869473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:44.871386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:44.915742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18042-15cf-4641-94fc-a64a0a6f8bde admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:44.920464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:44.921338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:44.921622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:44.921894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] PATH_INFO: `/v3/users/9c07d0c5f4f54a649c1fbf7ebe483c20` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:44.923120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c07d0c5f4f54a649c1fbf7ebe483c20)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:44.925097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:44.993089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 977/1944] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:44 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:44.997119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.011227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3312cdf-46aa-4b98-8a2d-6a3c70b3d4e1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.016669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.017341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.017628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.022039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.022039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.022039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.035797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 978/1945] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:45.039405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.049067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd84ab-db74-4dfb-8dc9-84677db378fd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.055331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.055331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.055331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.055331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.056551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.058115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.068884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 979/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:45.078441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.089734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8639d5-e269-46f5-8e01-b86ba3417c23 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.094679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.095463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.095775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.096059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] PATH_INFO: `/v3/projects/dd11ed3d7bc243a193b91e5e6d6b951a/users/a777df4672684498b4f973aa09e71fb8/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.111847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd11ed3d7bc243a193b91e5e6d6b951a, user_id=a777df4672684498b4f973aa09e71fb8, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.114568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d9c59-37cb-4d90-8d1c-896eb3e7e635 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.232377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 980/1947] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:45 2022] PUT /identity/v3/projects/dd11ed3d7bc243a193b91e5e6d6b951a/users/a777df4672684498b4f973aa09e71fb8/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:45.243651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.243966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.244252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.271521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] MFA Rules not processed for user `a777df4672684498b4f973aa09e71fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:45.272760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:45.285567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c07d0c5f4f54a649c1fbf7ebe483c20'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:45.286429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c07d0c5f4f54a649c1fbf7ebe483c20'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:45.293864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c07d0c5f4f54a649c1fbf7ebe483c20'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:45.311908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c07d0c5f4f54a649c1fbf7ebe483c20'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:45.340598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 981/1948] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:45.344110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.393773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-78163708-9df9-4e53-a54c-1f05eaa2d7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c07d0c5f4f54a649c1fbf7ebe483c20'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:45.402411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 968/1949] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:44 2022] DELETE /identity/v3/users/9c07d0c5f4f54a649c1fbf7ebe483c20 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:45.406560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.407921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.408210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.412431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6d9b-1518-44df-b9c6-26bd43024c5c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.426894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:45.428291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:45.477709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.478903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.479367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.480338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.481343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.487391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.500942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 969/1950] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:45.511494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.533848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:45.573516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 982/1951] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:45 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:45.577855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.579669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:45.596868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fff40-9fad-49c1-b505-2f9d218acd4a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.654543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49831-2c03-4e23-9f74-b9768c9024e6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.656914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.657584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.657869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.658308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.662556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.663301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.663698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.664048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.665738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.668223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.675756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.677486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.693389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 970/1952] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:45.702609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:45.760036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 983/1953] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:45 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:45.764241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.774179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd49d-123f-4e00-a2bd-fae1e3664768 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.779369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.780311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.780752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.781406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.782417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.784181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:45.786272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.806677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 971/1954] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:45.810750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.822585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e746477-ed89-4b2a-a22f-ec1b1187747a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.826836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.827446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.827762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.828040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.828761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.830382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728a5b-5f85-4577-944a-7c867ea2b14a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.841113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 984/1955] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:45.844941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:45.855195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1c5e-61ed-4afa-bcf4-2cee3e54f9a7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:45.860575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:45.861455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.861739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.862015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] PATH_INFO: `/v3/projects/523a691a476b423580f5e816adc91de1/users/f3e95fdf6be6426a9cd575b4955b02bc/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:45.877139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523a691a476b423580f5e816adc91de1, user_id=f3e95fdf6be6426a9cd575b4955b02bc, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:45.879906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:45.964411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 972/1956] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:45 2022] PUT /identity/v3/projects/523a691a476b423580f5e816adc91de1/users/f3e95fdf6be6426a9cd575b4955b02bc/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:45.964592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:45.964983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:45.965343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.024353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] MFA Rules not processed for user `f3e95fdf6be6426a9cd575b4955b02bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:46.025754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.121569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 985/1957] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:46.126060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.126217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.127833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.203978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba49f2a-7948-47cf-9964-37d31cbfae7e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.205598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff16db-e360-44c0-9f22-3f9740948cb5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.210736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.211555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.211833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.211999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.212132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.212861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.213708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.213894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.214181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] PATH_INFO: `/v3/users/31330569c9b14b7585905ce988dac053` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.215375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.215603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31330569c9b14b7585905ce988dac053)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.217624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.297781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 986/1958] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:46.298777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.301158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:46.302952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.366255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb69a6-be27-4c30-9e8e-8364df7d45be admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.371434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.372319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.372658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.372919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] PATH_INFO: `/v3/projects/a45fd9abac95450f8dedf8836aa6cccb` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.374080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45fd9abac95450f8dedf8836aa6cccb)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.376006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.418529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31330569c9b14b7585905ce988dac053'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.419545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31330569c9b14b7585905ce988dac053'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.426593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31330569c9b14b7585905ce988dac053'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.439129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31330569c9b14b7585905ce988dac053'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.519285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45fd9abac95450f8dedf8836aa6cccb', 'request_id': 'req-bbf050c2-b336-42f7-bd9c-2e44f775e12e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.526256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31330569c9b14b7585905ce988dac053'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.532947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 973/1959] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:46 2022] DELETE /identity/v3/users/31330569c9b14b7585905ce988dac053 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:46.533823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.535502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.603810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb649-79a9-4f8b-bf12-a3841c695c71 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.615859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.615859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.615859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.615859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.616206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45fd9abac95450f8dedf8836aa6cccb', 'request_id': 'req-bbf050c2-b336-42f7-bd9c-2e44f775e12e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.616519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.616519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.618204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45fd9abac95450f8dedf8836aa6cccb', 'request_id': 'req-bbf050c2-b336-42f7-bd9c-2e44f775e12e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.630790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] The token cache is being invalidate because project a45fd9abac95450f8dedf8836aa6cccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:46.631083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.631783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bbf050c2-b336-42f7-bd9c-2e44f775e12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.633391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 987/1960] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:46 2022] DELETE /identity/v3/projects/a45fd9abac95450f8dedf8836aa6cccb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:46.637642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.637932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.638211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.656486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:46.657709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.666695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 988/1961] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:46.670504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.671602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:46.672675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.685356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b69a33-976f-419c-bfc2-9d7c2e1efb8f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.690243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.691118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.691406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.691825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] PATH_INFO: `/v3/users/52a4f902346e4db6b99e333933f4602c` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.693046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a4f902346e4db6b99e333933f4602c)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.695007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.721077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 974/1962] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:46 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:46.721077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.721077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.783748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4ce3-88ad-43c6-85b1-4d4c03978489 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.787546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.788204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.788487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.788793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.799737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.801736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.808600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:46.814463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 975/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:46.815366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.816783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:46.832767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0e6b-9e2c-4d61-b864-55eb84ba462a service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.838738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.839636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.839997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.840347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.841148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.843186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:46.855195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 976/1964] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:46.859088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:46.873379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79271f-032a-4ef1-a121-b92686c56388 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:46.878621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:46.879729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:46.883288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a4f902346e4db6b99e333933f4602c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.884378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a4f902346e4db6b99e333933f4602c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:46.888119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:46.893503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] PATH_INFO: `/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e/users/54228ae4fccc40279fb718b7986badbe/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:46.910774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510a5bf59b5b4829ac401a2b51a1f20e, user_id=54228ae4fccc40279fb718b7986badbe, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:46.918990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.016329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a4f902346e4db6b99e333933f4602c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.022744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 977/1965] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:46 2022] PUT /identity/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e/users/54228ae4fccc40279fb718b7986badbe/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:47.027336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.029071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.032960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a4f902346e4db6b99e333933f4602c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.043565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a4f902346e4db6b99e333933f4602c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.050350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 989/1966] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:46 2022] DELETE /identity/v3/users/52a4f902346e4db6b99e333933f4602c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:47.102083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9185-8d45-4781-ab73-46032e2e80a9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.174364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.175067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.175381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.175687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.176417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.178018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588de614-c6ed-4d10-b796-eaa2f9a6704c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.189042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 978/1967] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:47.193126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.203150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262d3f-d4f3-432e-be9d-596eee7dca44 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.208085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.208967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.209254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.209569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] PATH_INFO: `/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e/users/54228ae4fccc40279fb718b7986badbe/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.212204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510a5bf59b5b4829ac401a2b51a1f20e, user_id=54228ae4fccc40279fb718b7986badbe, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.214876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.225418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 990/1968] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:47 2022] PUT /identity/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e/users/54228ae4fccc40279fb718b7986badbe/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:47.236308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.236607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.236891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.273235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] MFA Rules not processed for user `54228ae4fccc40279fb718b7986badbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:47.275099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.286100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.288075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.331042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:47.360379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 979/1969] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:47.363566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72cd2b-0ad9-496b-bb5f-344f18f2ced0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.369791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.370864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.374000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.374000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] PATH_INFO: `/v3/projects/f0d472180137463c9b24967ac9ea3235` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.374000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d472180137463c9b24967ac9ea3235)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.374249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.374685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.374971 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.402648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:47.439103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74c6a7-a36e-4fbf-8c3b-abfe47afb133 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.442961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.443648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.444062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.444353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.447117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.503270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.504933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.506555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d472180137463c9b24967ac9ea3235', 'request_id': 'req-47de12f8-e5e0-4b96-8f44-7114876ed572'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.514951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 980/1970] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:47.525463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.527192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.542898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd1b6c-ff7f-4e93-a670-99e7a4085f24 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.597198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d472180137463c9b24967ac9ea3235', 'request_id': 'req-47de12f8-e5e0-4b96-8f44-7114876ed572'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.603478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.604379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.604670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.604929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d472180137463c9b24967ac9ea3235', 'request_id': 'req-47de12f8-e5e0-4b96-8f44-7114876ed572'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.605047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] PATH_INFO: `/v3/projects/1a1338bd1ec9423189f432bb6233fd39` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.606128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1338bd1ec9423189f432bb6233fd39)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.608129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.618056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] The token cache is being invalidate because project f0d472180137463c9b24967ac9ea3235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:47.618403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.619095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.621604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 991/1971] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:47 2022] DELETE /identity/v3/projects/f0d472180137463c9b24967ac9ea3235 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:47.626081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.627836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.642941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de12f8-e5e0-4b96-8f44-7114876ed572 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.647737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:47.648701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.648980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.649260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] PATH_INFO: `/v3/users/8b40bc036d9c4ee8be509c8abf7cae85` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.650447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b40bc036d9c4ee8be509c8abf7cae85)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:47.652383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:47.724069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1338bd1ec9423189f432bb6233fd39', 'request_id': 'req-5312cb00-7af3-4fc1-b43e-1403ab03b206'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.731148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1338bd1ec9423189f432bb6233fd39', 'request_id': 'req-5312cb00-7af3-4fc1-b43e-1403ab03b206'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.821573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1338bd1ec9423189f432bb6233fd39', 'request_id': 'req-5312cb00-7af3-4fc1-b43e-1403ab03b206'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.832486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] The token cache is being invalidate because project 1a1338bd1ec9423189f432bb6233fd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:47.832777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.833449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5312cb00-7af3-4fc1-b43e-1403ab03b206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.835010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 981/1972] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:47 2022] DELETE /identity/v3/projects/1a1338bd1ec9423189f432bb6233fd39 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:47.839857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a85ab-8d18-40b0-9bbb-bdb99d9b846f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.840150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a85ab-8d18-40b0-9bbb-bdb99d9b846f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.840433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a85ab-8d18-40b0-9bbb-bdb99d9b846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.862650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bd5a85ab-8d18-40b0-9bbb-bdb99d9b846f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:47.863904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bd5a85ab-8d18-40b0-9bbb-bdb99d9b846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.866262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b40bc036d9c4ee8be509c8abf7cae85'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.866927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b40bc036d9c4ee8be509c8abf7cae85'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.927980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 982/1973] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:47.935919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:47.936216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:47.936594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:47.956117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:47.957333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:47.966224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 983/1974] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:47.970200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:47.973782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b40bc036d9c4ee8be509c8abf7cae85'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:47.991393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebca86-c786-4748-af8a-91656ef53868 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:47.991762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b40bc036d9c4ee8be509c8abf7cae85'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.001520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b40bc036d9c4ee8be509c8abf7cae85'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.003287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.004504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.004961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.005246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.005986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:48.006299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.009341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.010437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 992/1975] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:47 2022] DELETE /identity/v3/users/8b40bc036d9c4ee8be509c8abf7cae85 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:48.024989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 984/1976] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:09:48.026184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.083069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:48.101783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89dea9-8ee3-43e4-abaf-88bf5f609982 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.106723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.107655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.108021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.108380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.109147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.111122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.209974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 993/1977] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:48.211829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.221968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba748e3-c0d6-428a-9efa-107fc51b6971 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.289169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.290052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.290412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.290755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.291554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.293573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.296774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:48.403591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 985/1978] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:48.407499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.418393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311178e-9352-4e3f-be7e-2bf8f4b2efcf admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.423250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.423975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.424256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.424532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.425253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.426893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.439186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 994/1979] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:48.443149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.451949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:48.455763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bca88-71c0-4569-ac78-a78704130a62 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.462039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.462831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.463357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.463493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.463803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.464754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.465071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:48.466487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.478322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 986/1980] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:48.478999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4932ebd-563b-4967-83b7-79f74b490cf6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.482459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.484160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.485296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.489934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.489934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] PATH_INFO: `/v3/projects/862001af9de844b6a83ba04376c7b77e` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.489934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862001af9de844b6a83ba04376c7b77e)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.489934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.495046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e565-473c-4a20-b00e-9f937e302c64 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.501255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.502146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.502461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.502742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] PATH_INFO: `/v3/projects/5c0caa8fb6d74490ac8d38761693bff2/users/9d230b83a30649c48f0da88ed7f5e3d5/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.519040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0caa8fb6d74490ac8d38761693bff2, user_id=9d230b83a30649c48f0da88ed7f5e3d5, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.521762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939398a9-015a-4232-b3e0-ae3a8800cd81 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.597144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 987/1981] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:48 2022] PUT /identity/v3/projects/5c0caa8fb6d74490ac8d38761693bff2/users/9d230b83a30649c48f0da88ed7f5e3d5/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:48.605879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862001af9de844b6a83ba04376c7b77e', 'request_id': 'req-18f5a93a-5404-4820-ab45-e89eeca5aa52'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.608619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.609028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.609415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.636291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] MFA Rules not processed for user `9d230b83a30649c48f0da88ed7f5e3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:48.637515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:48.699611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862001af9de844b6a83ba04376c7b77e', 'request_id': 'req-18f5a93a-5404-4820-ab45-e89eeca5aa52'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.701330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 988/1982] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:48.706058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.706191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862001af9de844b6a83ba04376c7b77e', 'request_id': 'req-18f5a93a-5404-4820-ab45-e89eeca5aa52'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.718328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] The token cache is being invalidate because project 862001af9de844b6a83ba04376c7b77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:48.718615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.719303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-18f5a93a-5404-4820-ab45-e89eeca5aa52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:48.720941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 995/1983] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:48 2022] DELETE /identity/v3/projects/862001af9de844b6a83ba04376c7b77e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:48.725549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c11f-bde1-4303-b075-391258cbea04 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.725836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c11f-bde1-4303-b075-391258cbea04 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.726117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c11f-bde1-4303-b075-391258cbea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.745983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e605c11f-bde1-4303-b075-391258cbea04 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:48.747109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e605c11f-bde1-4303-b075-391258cbea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:48.769366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cba0a-c9e8-4146-940f-f6ed10342ecf None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.774959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.775651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.775945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.776224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.776922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.778924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.805765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 996/1984] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:48.815866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.816167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.816869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.842478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:48.844086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:48.855726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 997/1985] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:48.860994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.874467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55a8d-38ae-4361-89a0-cffbd056f5af None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.876958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 989/1986] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:48.890536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.890536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:48.936352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:48.942688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.943434 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.943880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.944234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.945131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:48.945534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.947461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.950719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914588e8-8a2e-431e-a933-75afc3cd2d54 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.955669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.956342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.959868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.959868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.959868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.960236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 998/1987] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:48.960314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:48.963952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:48.974942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf5bf8-83f1-41d9-a685-20e7ff773ff3 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:48.979744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:48.980427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:48.980713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:48.985820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:48.985820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:48.985820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.008805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:49.078142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 990/1988] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:49.082551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 999/1989] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:48 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:49.082708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.083286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.092878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8319755-d60a-4b27-afba-8eefdd76390b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.152274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2f25-853d-43e0-9d83-73763a48511f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.155443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.156158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.156473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.157037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.157674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.157815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.158852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.159618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.159989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.160752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.161016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.162673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.171907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 991/1990] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:49.176015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.186103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b320-a86d-444d-9a1a-4c7cd038d7d9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.191354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.192256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.192541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.192814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] PATH_INFO: `/v3/projects/2ec932f212b24495b28890f523e261c3/users/0dd157fb185444e8a43abd9b221bb133/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.208327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec932f212b24495b28890f523e261c3, user_id=0dd157fb185444e8a43abd9b221bb133, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.212109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.280104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1000/1991] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:49 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:49.288270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.298715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49387f-fd86-427a-a5a3-8047feb7d775 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.303629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.304286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.304574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.305561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.306314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.307934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.313403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 992/1992] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:49 2022] PUT /identity/v3/projects/2ec932f212b24495b28890f523e261c3/users/0dd157fb185444e8a43abd9b221bb133/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:49.318635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1001/1993] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:49.319336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.322177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.331906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e39ff-5002-4c91-8524-49f72b2fba54 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.380906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2058-6a35-4507-9198-4afdf356b2ab admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.386039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.386708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.387006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.387282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.388068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.389929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.390421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.391092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.391381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.391715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.392448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.394037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.400656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 993/1994] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:49.405220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.410820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1002/1995] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:49.411713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.413496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:49.417943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f01b13-a2e6-4b27-ab6e-e21403b24b17 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.421919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474bc81-9284-4d7d-b2b1-bb555fde7fbf admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.422875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.423792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.424071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.424346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] PATH_INFO: `/v3/projects/2ec932f212b24495b28890f523e261c3/users/0dd157fb185444e8a43abd9b221bb133/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.426322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec932f212b24495b28890f523e261c3, user_id=0dd157fb185444e8a43abd9b221bb133, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.426677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.427568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.427860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.428139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] PATH_INFO: `/v3/projects/bd53114a1ca7475e8fc38781b12804e5/users/05ac464eb6624f0abf84b14f299931b3/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.428976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737492c5-af58-4886-ade3-6565c4a9c05d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.440012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 994/1996] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:49 2022] PUT /identity/v3/projects/2ec932f212b24495b28890f523e261c3/users/0dd157fb185444e8a43abd9b221bb133/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:49.448984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd53114a1ca7475e8fc38781b12804e5, user_id=05ac464eb6624f0abf84b14f299931b3, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.448984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f09d7-96a0-4808-888f-61188d888169 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.450384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.450898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.450989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.477622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] MFA Rules not processed for user `0dd157fb185444e8a43abd9b221bb133`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:49.478882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:49.531069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1003/1997] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:49 2022] PUT /identity/v3/projects/bd53114a1ca7475e8fc38781b12804e5/users/05ac464eb6624f0abf84b14f299931b3/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:49.541948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.542246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.542530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.547897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 995/1998] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:49.566846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.568268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:49.570570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] MFA Rules not processed for user `05ac464eb6624f0abf84b14f299931b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:49.571768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:49.580141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:49.604990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:49.626786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271bf0e-5e65-4a12-b38d-a9b38be0248c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.639122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1004/1999] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:49.643712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.678556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.679208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.679496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.679864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.705678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf8156-d645-476a-be8e-6bb3f81b527c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.710392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.711813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.712189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.712472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.713169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.715101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.740982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.742428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.751863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 996/2000] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:49.779981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1005/2001] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:49.781665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.792882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36ba32-f50a-43e3-99a1-5ade928ef62a service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.850547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.851226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.851517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.852159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.853090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.855103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.940018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 997/2002] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:49 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:49.941209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.952441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb42b-3242-4f28-8dfd-666ecb3e41b2 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.957058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.957717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.958001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.958275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:49.959037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:49.960693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:49.972353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1006/2003] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:49.976864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:49.987328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cce07-a78a-4053-9f77-f4e6d4f3c24e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:49.992499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:49.993758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:49.993758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:49.993974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] PATH_INFO: `/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53/users/27212db027ad4c7dabc2459bd417cb0d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:50.016485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edc8d7b188e44c0a0c9ac87d3677e53, user_id=27212db027ad4c7dabc2459bd417cb0d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:50.019710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:50.097975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 998/2004] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:49 2022] PUT /identity/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53/users/27212db027ad4c7dabc2459bd417cb0d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:50.101533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:50.111812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0fe13-02f4-4399-a96e-e51fb5855144 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:50.181537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:50.182240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:50.182529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:50.182805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:50.183551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:50.185185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb51431-0868-47e3-ade6-f6522c8a40b4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:50.195167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1007/2005] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:50.200361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:50.207117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:50.211871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe899-15fc-423e-8250-9b71c5028e4a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:50.216586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:50.217463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:50.217751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:50.218027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] PATH_INFO: `/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53/users/27212db027ad4c7dabc2459bd417cb0d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:50.220018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edc8d7b188e44c0a0c9ac87d3677e53, user_id=27212db027ad4c7dabc2459bd417cb0d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:50.222638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:50.232913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 999/2006] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:50 2022] PUT /identity/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53/users/27212db027ad4c7dabc2459bd417cb0d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:50.257582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:50.258578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:50.258931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:50.286850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] MFA Rules not processed for user `27212db027ad4c7dabc2459bd417cb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:50.288096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:50.311731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:50.370013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1008/2007] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:50.554401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:50.556777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:50.620386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c01fe-06dd-45c1-baf5-d78252697daa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:50.624131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:50.624861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:50.625209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:50.625494 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:50.681712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:50.683136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:50.691856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1000/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:51.307176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:51.316610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3414269-1968-4377-8cbd-303e274124f4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:51.320372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:51.321018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:51.321814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:51.322097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:51.323969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:51.382559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:51.384750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ffd3-b90a-4193-831f-db4ade79a364 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:51.394503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1009/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:51.688732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:51.754196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ff833-b60f-43cd-8049-f949e018cca5 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:51.758793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:51.759688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:51.759972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:51.760247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] PATH_INFO: `/v3/users/9d230b83a30649c48f0da88ed7f5e3d5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:51.761579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d230b83a30649c48f0da88ed7f5e3d5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:51.763932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:51.999567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d230b83a30649c48f0da88ed7f5e3d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:52.000174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d230b83a30649c48f0da88ed7f5e3d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:52.001637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:52.007991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d230b83a30649c48f0da88ed7f5e3d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:52.020806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d230b83a30649c48f0da88ed7f5e3d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:52.089969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d230b83a30649c48f0da88ed7f5e3d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:52.096542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1001/2010] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:51 2022] DELETE /identity/v3/users/9d230b83a30649c48f0da88ed7f5e3d5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:52.101349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:52.101644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:52.101924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:52.125454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:52.125454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:52.181795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1010/2011] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:52.191093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:52.193098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:52.254060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ec4f-3454-4020-9530-88d821012fe0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:52.257617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:52.258265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:52.258548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:52.259350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:52.275105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:52.275105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:52.281937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1002/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:52.768300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:52.768300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:52.779426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829a37-3bca-4360-8c76-0aadf4188b29 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:52.784688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:52.785893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:52.786295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:52.786656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] PATH_INFO: `/v3/projects/5c0caa8fb6d74490ac8d38761693bff2` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:52.788108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0caa8fb6d74490ac8d38761693bff2)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:52.791627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:52.924799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:52.931870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0caa8fb6d74490ac8d38761693bff2', 'request_id': 'req-30c2d5a6-041f-47e0-a817-a3d9442363cb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.063411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0caa8fb6d74490ac8d38761693bff2', 'request_id': 'req-30c2d5a6-041f-47e0-a817-a3d9442363cb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.070376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0caa8fb6d74490ac8d38761693bff2', 'request_id': 'req-30c2d5a6-041f-47e0-a817-a3d9442363cb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.083783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] The token cache is being invalidate because project 5c0caa8fb6d74490ac8d38761693bff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:53.084192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.084858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.086671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1011/2013] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:52 2022] DELETE /identity/v3/projects/5c0caa8fb6d74490ac8d38761693bff2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:53.091062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:53.101636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badc4cb-9aae-4326-9ace-10b967b8a77a service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:53.172288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:53.173196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:53.173503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:53.173782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] PATH_INFO: `/v3/users/0dd157fb185444e8a43abd9b221bb133` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:53.174989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd157fb185444e8a43abd9b221bb133)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:53.176933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:53.223009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:53.224502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:53.293965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2d5a6-041f-47e0-a817-a3d9442363cb admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:53.297989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:53.298646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:53.298933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:53.299211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:53.301376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:53.369335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:53.370761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:53.380270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1012/2014] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:53.416361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd157fb185444e8a43abd9b221bb133'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.417076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd157fb185444e8a43abd9b221bb133'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.424175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd157fb185444e8a43abd9b221bb133'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.434858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:53.437059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd157fb185444e8a43abd9b221bb133'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.510959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5986393e-82a9-4164-91aa-f342cac4dd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd157fb185444e8a43abd9b221bb133'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:53.517899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1003/2015] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:53 2022] DELETE /identity/v3/users/0dd157fb185444e8a43abd9b221bb133 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:53.943012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:53.944613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:53.965606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1153c2-6bfe-4d55-b51c-96dc7656a80d service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.027481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.028414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.028700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.028978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] PATH_INFO: `/v3/projects/2ec932f212b24495b28890f523e261c3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.030303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec932f212b24495b28890f523e261c3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.032249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.054052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:54.192285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec932f212b24495b28890f523e261c3', 'request_id': 'req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.243437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec932f212b24495b28890f523e261c3', 'request_id': 'req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.249517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec932f212b24495b28890f523e261c3', 'request_id': 'req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.260869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] The token cache is being invalidate because project 2ec932f212b24495b28890f523e261c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:54.261159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.261795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ed5eb3bb-78f2-47c3-8a94-0eaca87eccfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.263601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1013/2016] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:53 2022] DELETE /identity/v3/projects/2ec932f212b24495b28890f523e261c3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:54.269663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.270119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.270224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.288898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:54.290723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:54.351670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1004/2017] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:54.359617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.359913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.360192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.378240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:54.379447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:54.388419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1014/2018] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:54.392710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.402803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b68bb-92a7-4ef9-816e-5229988334d2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.408334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.408334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.408334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.408624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.409287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:54.409615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.411321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.424039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1005/2019] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:54.429782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.441028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d65a6-0a97-49d2-8f59-7922e4f01f4c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.446469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.447190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.447506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.448624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.448624 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.450523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.536835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1015/2020] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:54.541987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.551783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817f17-4377-471c-8b47-2f817142b745 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.595439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.597674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:54.611150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.611859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.612147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.612455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.613146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.615058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.665357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5264f-0df4-46f5-97f7-2c0e466e798e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.670032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.670908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.671312 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.671626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] PATH_INFO: `/v3/users/4cbb28bd16a244a7b41ba70581ecb785` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.673022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbb28bd16a244a7b41ba70581ecb785)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.675013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.694819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1006/2021] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:54.699504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.709449 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4be74-13cf-4379-b045-187b34ea599e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.715008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.715740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.716025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.716325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.717035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.718671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.729440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1007/2022] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:54.733262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.742859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be3a3-5608-413b-930b-c253a511a60a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.747792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.748417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.748705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.748984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.749741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.751312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.761746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1008/2023] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:54.765768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:54.776014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3423-eb71-440e-bcbb-d2061fc562cb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:54.780713 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:54.781566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.781861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.782139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] PATH_INFO: `/v3/projects/9e443c2a3ddb4a06924608159da7f3a2/users/dcd03540ffa44155b7ac1d7da0ef70fe/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.797202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e443c2a3ddb4a06924608159da7f3a2, user_id=dcd03540ffa44155b7ac1d7da0ef70fe, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:54.799877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39ffaa-e913-455f-873c-b2cac9dfcfd1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:54.878072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbb28bd16a244a7b41ba70581ecb785'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.878745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbb28bd16a244a7b41ba70581ecb785'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.908963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1009/2024] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:54 2022] PUT /identity/v3/projects/9e443c2a3ddb4a06924608159da7f3a2/users/dcd03540ffa44155b7ac1d7da0ef70fe/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:54.917456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:54.917752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:54.918035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:54.944251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] MFA Rules not processed for user `dcd03540ffa44155b7ac1d7da0ef70fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:54.945513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:54.951041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:54.968335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbb28bd16a244a7b41ba70581ecb785'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.982362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbb28bd16a244a7b41ba70581ecb785'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.989313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fcaa7328-3fd9-4ed6-a491-1133bc84b1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbb28bd16a244a7b41ba70581ecb785'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:54.990895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:54.996174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1016/2025] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:54 2022] DELETE /identity/v3/users/4cbb28bd16a244a7b41ba70581ecb785 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:55.000512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:55.000908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:55.002638 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:55.017898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1010/2026] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:55.025814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:55.027049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:55.029702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:55.031049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:55.090388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a915-22c7-4bc2-b430-8ea5abed17ab None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:55.092891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1017/2027] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:09:55.111156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:55.115135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:55.146293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:55.147401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:55.147875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:55.148322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:55.176112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331607-ce83-4df6-8911-9e8c069a5418 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:55.179996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:55.180726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:55.181037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:55.181295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:55.197912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:55.199400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:55.209161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1018/2028] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:09:55.216756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:55.218249 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:55.227954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1011/2029] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:55.594454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:55.596032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:55.609100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93b8c-0d73-4892-b78f-da809d11ad5d service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:55.614067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:55.625045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:55.625045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:55.625045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] PATH_INFO: `/v3/projects/e6209d9e18bd4f89b7ecf0f135ebfd2b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:55.625045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6209d9e18bd4f89b7ecf0f135ebfd2b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:55.625045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:55.743404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6209d9e18bd4f89b7ecf0f135ebfd2b', 'request_id': 'req-f63d69dc-6d7a-4b87-9503-e56e401afb16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:55.815252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6209d9e18bd4f89b7ecf0f135ebfd2b', 'request_id': 'req-f63d69dc-6d7a-4b87-9503-e56e401afb16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:55.821691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6209d9e18bd4f89b7ecf0f135ebfd2b', 'request_id': 'req-f63d69dc-6d7a-4b87-9503-e56e401afb16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:55.832775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] The token cache is being invalidate because project e6209d9e18bd4f89b7ecf0f135ebfd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:55.833069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:55.833725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:55.835250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1019/2030] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:55 2022] DELETE /identity/v3/projects/e6209d9e18bd4f89b7ecf0f135ebfd2b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:55.839421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:55.850617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b750d-6ae4-45d9-963b-9fad59ced736 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:55.863931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:55.909374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:55.910294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:55.910542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:55.910832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] PATH_INFO: `/v3/users/67dfd944211940ed9dab5dfd4ee19387` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:55.912076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67dfd944211940ed9dab5dfd4ee19387)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:55.914027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:56.127542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67dfd944211940ed9dab5dfd4ee19387'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:56.128345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67dfd944211940ed9dab5dfd4ee19387'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:56.135457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67dfd944211940ed9dab5dfd4ee19387'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:56.147259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67dfd944211940ed9dab5dfd4ee19387'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:56.226627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9b9eaea6-c5c7-40ff-b22e-9ebd14a2bf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67dfd944211940ed9dab5dfd4ee19387'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:56.233963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1012/2031] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:09:55 2022] DELETE /identity/v3/users/67dfd944211940ed9dab5dfd4ee19387 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:56.712550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:56.714012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:56.730328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d69dc-6d7a-4b87-9503-e56e401afb16 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:56.752304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:56.795401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:56.796971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:56.797284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:56.797532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] PATH_INFO: `/v3/projects/a3cf363194494387b2698a903e0ce55b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:56.799430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cf363194494387b2698a903e0ce55b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:56.801796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:56.940311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cf363194494387b2698a903e0ce55b', 'request_id': 'req-b184b586-ad23-400e-83eb-a820e2ce1f94'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:57.026981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cf363194494387b2698a903e0ce55b', 'request_id': 'req-b184b586-ad23-400e-83eb-a820e2ce1f94'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:57.035233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cf363194494387b2698a903e0ce55b', 'request_id': 'req-b184b586-ad23-400e-83eb-a820e2ce1f94'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:57.048541 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] The token cache is being invalidate because project a3cf363194494387b2698a903e0ce55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:57.048839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:57.049599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b184b586-ad23-400e-83eb-a820e2ce1f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:57.051168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1020/2032] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:56 2022] DELETE /identity/v3/projects/a3cf363194494387b2698a903e0ce55b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:09:57.057313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.057796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.057896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.076731 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:57.077912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:57.139558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1013/2033] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:57.148760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.149594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.149878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.170393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:57.171637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:57.179695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1021/2034] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:57.184278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.194078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf8dac-7a0e-433f-9d22-66fcbb26f589 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.198929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.199621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.199916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.200195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.200916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:57.201226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.202844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.214884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1014/2035] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:57.219277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.229562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d8cd1-5ff8-4829-b754-094b2780d3da None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.234282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.234929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.235219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.235498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.236220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.238156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.297501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1022/2036] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:57.301709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.312510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37b35c-8363-4a22-8d07-bd9a80199b9a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.344252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:57.397253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.398135 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.398430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.399620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.400348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.402656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.442839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.444743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:57.483977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1015/2037] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:57.485199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.499338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7be2-3358-4e08-bf7a-5d89f1b7931f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.505278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.507686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.507686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.507686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.507686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.510533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.517081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8096b2b-38c2-4b12-9f7f-9bd59e077534 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.521577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.522918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.524184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1016/2038] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:57.526773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.527486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.530399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.530524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:57.538954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b870-9cc4-47ef-bf71-8862d93e1782 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.545418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.546238 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.546632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.547165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.548013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.549746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.561070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1017/2039] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:09:57.565134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.575085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfdb9-e231-4607-868a-40d5ce88862e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.579705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:57.582078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.582958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.583244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.583549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] PATH_INFO: `/v3/projects/8d5f17f3058641c0855cc69311c2e452/users/142acd2e119c4336843e1fd6074406c5/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.601104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5f17f3058641c0855cc69311c2e452, user_id=142acd2e119c4336843e1fd6074406c5, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.604608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.604770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.606255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341e45-f51a-4112-8ba2-408ccde806bb service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.616269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1023/2040] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:57.676603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1018/2041] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:57 2022] PUT /identity/v3/projects/8d5f17f3058641c0855cc69311c2e452/users/142acd2e119c4336843e1fd6074406c5/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:57.687702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.688003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.688288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.715311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] MFA Rules not processed for user `142acd2e119c4336843e1fd6074406c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:57.720951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:57.783241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1024/2042] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:57.788292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.850785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ad04f-cd08-4db9-b290-715298d60e66 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:57.856263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:57.856864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:57.857153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:57.857468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:57.858203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:57.860138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:57.969270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1019/2043] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:57.970414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:57.981750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ea7b-98a9-4ccc-bb80-b2bd6652cc6b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.037214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.037884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.038175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.038453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.039148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.041868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.126525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1025/2044] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:09:57 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:09:58.129798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:58.139278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d283-5c2d-4912-bd3d-3a8d924a6615 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.144323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.145180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.145358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.145602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.146334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.147974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.159395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1020/2045] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:58.163928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:58.174285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ea5b-d40e-47a9-ad25-c5930d2c54f0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.178962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.179882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.180207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.180507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] PATH_INFO: `/v3/projects/f924db58ba9a45f69f2c029a22094f78/users/d454057ad1de4300a58734bee8ad2344/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.197116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f924db58ba9a45f69f2c029a22094f78, user_id=d454057ad1de4300a58734bee8ad2344, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.199924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.299709 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1026/2046] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:58 2022] PUT /identity/v3/projects/f924db58ba9a45f69f2c029a22094f78/users/d454057ad1de4300a58734bee8ad2344/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:58.303542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:58.313681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885353-00d7-43dd-b30a-3c27e1e0ff97 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.356139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:58.372294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.372903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.373195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.373473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.374205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.375830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef123-e1e7-42b3-b175-856a62a52e27 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.386085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1021/2047] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:09:58.390606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:58.401958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd6d4-0e00-4207-b6b2-75175382c903 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.406598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.407475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.407801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.408077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] PATH_INFO: `/v3/projects/f924db58ba9a45f69f2c029a22094f78/users/d454057ad1de4300a58734bee8ad2344/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.410025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f924db58ba9a45f69f2c029a22094f78, user_id=d454057ad1de4300a58734bee8ad2344, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.412703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.423861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1027/2048] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:09:58 2022] PUT /identity/v3/projects/f924db58ba9a45f69f2c029a22094f78/users/d454057ad1de4300a58734bee8ad2344/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:09:58.437002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.437297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.437734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.464340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] MFA Rules not processed for user `d454057ad1de4300a58734bee8ad2344`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:09:58.465552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:09:58.537166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1022/2049] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:09:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:09:58.551193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:58.572438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:58.608655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499c6b-0b3a-4c9e-ba22-1580c8b708ef admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:58.612421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:58.615447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:58.615447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:58.615447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:58.624547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:58.625998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:58.637127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1028/2050] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:09:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:09:59.481004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:59.490866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad67-3377-4dfa-8009-b598f0ca32dc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:59.495604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd454057ad1de4300a58734bee8ad2344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f924db58ba9a45f69f2c029a22094f78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:59.496269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:59.496554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:59.496833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:59.497654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:59.497965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:59.499578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:59.511668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1023/2051] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:59.515958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:59.525533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ad8a0-378d-4afa-8844-3ef0d32ff451 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:59.529995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd454057ad1de4300a58734bee8ad2344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f924db58ba9a45f69f2c029a22094f78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:59.530633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:59.530918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:59.531194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:59.531922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:59.533802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:59.614662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1029/2052] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:09:59 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:09:59.619160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:59.629393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87249-f59d-42fc-ab6a-3deb7f29f1a8 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:59.685536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd454057ad1de4300a58734bee8ad2344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f924db58ba9a45f69f2c029a22094f78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:59.686200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:59.686487 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:59.686766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:59.687480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:09:59.687820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:59.689405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:59.700969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1024/2053] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:09:59.737527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:09:59.751216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267210-2674-40f0-8efe-83838bf06548 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:09:59.755505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd454057ad1de4300a58734bee8ad2344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f924db58ba9a45f69f2c029a22094f78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:09:59.756472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:09:59.756683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:09:59.756961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] PATH_INFO: `/v3/projects/1ce614207acf4429a17a0853e083de39` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:09:59.758725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ce614207acf4429a17a0853e083de39)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:09:59.760694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:09:59.878785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce614207acf4429a17a0853e083de39', 'request_id': 'req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:59.958243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce614207acf4429a17a0853e083de39', 'request_id': 'req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:59.965702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce614207acf4429a17a0853e083de39', 'request_id': 'req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:59.978202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] The token cache is being invalidate because project 1ce614207acf4429a17a0853e083de39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:09:59.978489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:59.979140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c94f194e-73fc-46c8-9f1b-adac92fcd0cc tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:09:59.980826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1030/2054] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:09:59 2022] DELETE /identity/v3/projects/1ce614207acf4429a17a0853e083de39 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:00.596227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:00.598067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:00.651718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:00.709228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52706-1881-43fa-b3be-aa3904a92367 tempest-VolumeQuotaClassesTest-396902517 tempest-VolumeQuotaClassesTest-396902517-project-admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:00.765024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:00.765899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:00.766178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:00.766568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] PATH_INFO: `/v3/users/142acd2e119c4336843e1fd6074406c5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:00.767827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=142acd2e119c4336843e1fd6074406c5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:00.769746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:01.008619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142acd2e119c4336843e1fd6074406c5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:01.009586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142acd2e119c4336843e1fd6074406c5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:01.017324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142acd2e119c4336843e1fd6074406c5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:01.030632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142acd2e119c4336843e1fd6074406c5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:01.093005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142acd2e119c4336843e1fd6074406c5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:01.100295 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1025/2055] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:00 2022] DELETE /identity/v3/users/142acd2e119c4336843e1fd6074406c5 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:01.105316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:01.105777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:01.108169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:01.124274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:01.125489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:01.185595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1031/2056] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:01.195167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:01.197484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:01.230282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:01.293653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c1fd-30c7-4e8e-a356-a6250978ad4d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:01.297794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:01.298441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:01.298734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:01.299017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:01.308318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:01.309883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:01.319787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1026/2057] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:01.759819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:01.761435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:01.778353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce585b0-af9e-4990-92cf-ef20f4c38a74 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:01.783282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:01.784212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:01.784503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:01.784810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] PATH_INFO: `/v3/projects/8d5f17f3058641c0855cc69311c2e452` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:01.785956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5f17f3058641c0855cc69311c2e452)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:01.787905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:01.812644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:01.915980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5f17f3058641c0855cc69311c2e452', 'request_id': 'req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.001908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5f17f3058641c0855cc69311c2e452', 'request_id': 'req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.008608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5f17f3058641c0855cc69311c2e452', 'request_id': 'req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.020273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] The token cache is being invalidate because project 8d5f17f3058641c0855cc69311c2e452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:02.020567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.021218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.022790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1032/2058] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:01 2022] DELETE /identity/v3/projects/8d5f17f3058641c0855cc69311c2e452 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:02.027401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:02.037903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b33da-ce3e-4757-a329-8fa1c612aaf1 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:02.097302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:02.097302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:02.097302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:02.097574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] PATH_INFO: `/v3/users/d454057ad1de4300a58734bee8ad2344` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:02.098803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d454057ad1de4300a58734bee8ad2344)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:02.100864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:02.344753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd454057ad1de4300a58734bee8ad2344'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.346429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd454057ad1de4300a58734bee8ad2344'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.354139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd454057ad1de4300a58734bee8ad2344'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.367296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd454057ad1de4300a58734bee8ad2344'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.443942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-765e31e6-3756-487e-b9aa-3a89470e1643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd454057ad1de4300a58734bee8ad2344'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:02.451748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1027/2059] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:02 2022] DELETE /identity/v3/users/d454057ad1de4300a58734bee8ad2344 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:02.850989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:02.852620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:02.881055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a28ac-da14-4763-b6b5-a8171ef7fe47 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:02.941734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:02.942630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:02.942916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:02.943216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] PATH_INFO: `/v3/projects/f924db58ba9a45f69f2c029a22094f78` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:02.944506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f924db58ba9a45f69f2c029a22094f78)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:02.947354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.065189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f924db58ba9a45f69f2c029a22094f78', 'request_id': 'req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:03.144345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f924db58ba9a45f69f2c029a22094f78', 'request_id': 'req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:03.151144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f924db58ba9a45f69f2c029a22094f78', 'request_id': 'req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:03.162172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] The token cache is being invalidate because project f924db58ba9a45f69f2c029a22094f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:03.162470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:03.163110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c5c41b0-a3e0-47ba-8ead-8f16ceb3746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:03.165345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1033/2060] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:02 2022] DELETE /identity/v3/projects/f924db58ba9a45f69f2c029a22094f78 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:03.170291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.170766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.170856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.188741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:03.190156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:03.198773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:03.248169 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1028/2061] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:03.256008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.256399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.256748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.277135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:03.278370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:03.286496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1034/2062] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:03.291475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.301443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377da12-38ae-4f3a-baf2-5d2332eea7c2 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.307254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.307952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.308240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.308525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.309257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:03.309570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.311353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.323810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1029/2063] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:10:03.328213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.338093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a60a60-cb0e-49ee-8467-fadbdc946f16 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.342976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.343664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.344601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.344987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.345897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.347856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.468934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1035/2064] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:03 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:03.472622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.484074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97089e3d-cd90-45a8-a768-355a19e35ed5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.542534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.543198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.543489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.543806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.544500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.546405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.670372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1030/2065] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:03 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:03.671576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.683067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dd7ca-5df4-4f4e-a5f0-7d2b43eeb713 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.688021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.688702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.688993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.689278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.691248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.691994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.693511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:03.703699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1036/2066] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:03.709682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.720919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5229e6-fba3-4cbc-a30d-8ba0d7554d88 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.725608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.726288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.726576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.727481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.728609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.730225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdae3b0-60ed-4822-9a6c-977218fc6550 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.740355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1031/2067] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:03.747499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:03.757488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394baa8-42cc-4973-a6b6-1e096ec55388 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:03.762121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:03.763243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.763544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.763845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] PATH_INFO: `/v3/projects/f4f67b04272a412986b0a8e374e318cb/users/a371874f73ef4e9b8dda465931c5aa3c/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.779095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f67b04272a412986b0a8e374e318cb, user_id=a371874f73ef4e9b8dda465931c5aa3c, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:03.782626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:03.894605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1037/2068] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:03 2022] PUT /identity/v3/projects/f4f67b04272a412986b0a8e374e318cb/users/a371874f73ef4e9b8dda465931c5aa3c/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:03.909137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:03.909360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:03.910053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:03.938302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] MFA Rules not processed for user `a371874f73ef4e9b8dda465931c5aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:03.939518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:04.004669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1032/2069] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:04.009140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.073180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ade80f-2f4e-41b0-92eb-4bce13cadf87 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.077891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.078548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.078834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.079112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.079836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.081723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.185456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1038/2070] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:04 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:04.189370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.200463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff398-5a16-4cbb-9af8-da5a1b28f188 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.205030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:04.255219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.255908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.256189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.256465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.257149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.259676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.341162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1033/2071] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:04 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:04.345209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.355606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44fed2-a50b-4b0a-8b1e-e1f4256325f4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.360241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.360894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.361177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.361453 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.362203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.363881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.374652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1039/2072] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:04.378606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.390150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd912d75-1552-4687-99b0-773a62f51273 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.394777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.395677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.395967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.396248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] PATH_INFO: `/v3/projects/f2696d0d3dfd4e938ec20470122817da/users/b1a2815c1d104e8fb61c12bd966189a5/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.411986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2696d0d3dfd4e938ec20470122817da, user_id=b1a2815c1d104e8fb61c12bd966189a5, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.414633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.480608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1034/2073] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:04 2022] PUT /identity/v3/projects/f2696d0d3dfd4e938ec20470122817da/users/b1a2815c1d104e8fb61c12bd966189a5/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:04.484851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.495151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a0ac8-4889-4156-a9a3-67b9c1b10b76 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.554853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.555779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.556072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.556944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.563165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.563165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd827a-414d-4c46-b0ac-857e3b429a61 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.570529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1040/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:04.574573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.587403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e57dd-90d0-4512-898e-455cb99a947d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.596534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.597436 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.597725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.598010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] PATH_INFO: `/v3/projects/f2696d0d3dfd4e938ec20470122817da/users/b1a2815c1d104e8fb61c12bd966189a5/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.600352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2696d0d3dfd4e938ec20470122817da, user_id=b1a2815c1d104e8fb61c12bd966189a5, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.603782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.616331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1035/2075] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:04 2022] PUT /identity/v3/projects/f2696d0d3dfd4e938ec20470122817da/users/b1a2815c1d104e8fb61c12bd966189a5/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:04.636386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.636386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.636386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.662121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] MFA Rules not processed for user `b1a2815c1d104e8fb61c12bd966189a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:04.663337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:04.696568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:04.743737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1041/2076] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:04.763599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:04.766640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:04.831870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e2c8b-e438-4c48-a902-77cc50aa07bb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:04.835681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:04.836322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:04.836604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:04.836968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:04.894992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:04.896478 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:04.907017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1036/2077] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:07.210724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:07.212353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:07.296496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9109a2-9ddc-450c-97ed-404488cc73e6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:07.301076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:07.301939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:07.302220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:07.302493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] PATH_INFO: `/v3/users/dcd03540ffa44155b7ac1d7da0ef70fe` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:07.303684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd03540ffa44155b7ac1d7da0ef70fe)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:07.305637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:07.462397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd03540ffa44155b7ac1d7da0ef70fe'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.463050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd03540ffa44155b7ac1d7da0ef70fe'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.559316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:07.560805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:07.563034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd03540ffa44155b7ac1d7da0ef70fe'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.578605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd03540ffa44155b7ac1d7da0ef70fe'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.589331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589c7c-a33c-4dc3-8ad9-d75d52ed796f service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:07.589331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:07.589331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:07.589331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:07.589840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] PATH_INFO: `/v3/users/a777df4672684498b4f973aa09e71fb8` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:07.589840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a777df4672684498b4f973aa09e71fb8)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:07.589840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:07.603687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-a6e6a90b-10f5-46b6-8b05-708c14626ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd03540ffa44155b7ac1d7da0ef70fe'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.604820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:07.615492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1042/2078] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:07 2022] DELETE /identity/v3/users/dcd03540ffa44155b7ac1d7da0ef70fe => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:07.620335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:07.620633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:07.620913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:07.680248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:07.681531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:07.701674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:07.743850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1043/2079] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:10:07.753896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:07.755257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:07.800727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a777df4672684498b4f973aa09e71fb8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.801387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a777df4672684498b4f973aa09e71fb8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.809020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a777df4672684498b4f973aa09e71fb8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.814487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1803-f188-4525-ba68-c5ef92f7cfee None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:07.818484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:07.819144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:07.819421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:07.819731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:07.821640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a777df4672684498b4f973aa09e71fb8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.829169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:07.830589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc205bb-73f7-42cb-9319-d521e3517170 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:07.840160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1044/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:10:07.940724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a777df4672684498b4f973aa09e71fb8'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:07.947414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1037/2081] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:07 2022] DELETE /identity/v3/users/a777df4672684498b4f973aa09e71fb8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:07.952058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:07.952359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:07.952645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:07.970762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:07.972033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.032604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1045/2082] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:08.043631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:08.045084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.105799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f591-8cd3-4cc2-9d2e-4fe53f46c414 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:08.109402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:08.110095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.110440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.110722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.122820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:08.124303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2db3c-3fbd-43c2-88f2-3f40973d5a32 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:08.134230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1038/2083] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:08.366510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:08.367984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.380427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7719b-008f-45c4-942e-2924ed4ecc06 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:08.387431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:08.388584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.388867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.389139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] PATH_INFO: `/v3/projects/9e443c2a3ddb4a06924608159da7f3a2` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.390470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e443c2a3ddb4a06924608159da7f3a2)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:08.392436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:08.513589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e443c2a3ddb4a06924608159da7f3a2', 'request_id': 'req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.595872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e443c2a3ddb4a06924608159da7f3a2', 'request_id': 'req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.600457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:08.602781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e443c2a3ddb4a06924608159da7f3a2', 'request_id': 'req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.617954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] The token cache is being invalidate because project 9e443c2a3ddb4a06924608159da7f3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:08.618350 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.619115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-da56e3cb-72ce-48da-aa76-7e3ba6ad875a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.625774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1046/2084] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:08 2022] DELETE /identity/v3/projects/9e443c2a3ddb4a06924608159da7f3a2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:08.626999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.627443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.627602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.671213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:08.671934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.734995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1039/2085] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:08.742881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.743175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.743461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.763027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:08.764262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.766330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:08.768008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:08.773310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1047/2086] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:08.778064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:08.784335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b767dee-fbd4-4a95-a52d-437913c86650 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:08.788970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33f36-1cb7-401c-bf4f-369d234ec8ca None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:08.789773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:08.790638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.791452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.791452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] PATH_INFO: `/v3/projects/dd11ed3d7bc243a193b91e5e6d6b951a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.792430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd11ed3d7bc243a193b91e5e6d6b951a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:08.794348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:08.800253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:08.802346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.802645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.803361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.803714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:08.804024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:08.805651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:08.833282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:08.833490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1048/2087] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:10:08.833490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:08.846846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bebbd9-937f-4b1a-a732-e1eea32b9616 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:08.851665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:08.852334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:08.852618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:08.852953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:08.853650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:08.855648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:08.963269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd11ed3d7bc243a193b91e5e6d6b951a', 'request_id': 'req-1a781f45-806a-4d8e-94f6-a35e64d3bda7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:08.969716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd11ed3d7bc243a193b91e5e6d6b951a', 'request_id': 'req-1a781f45-806a-4d8e-94f6-a35e64d3bda7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.022285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1049/2088] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:08 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:10:09.026524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.043658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd11ed3d7bc243a193b91e5e6d6b951a', 'request_id': 'req-1a781f45-806a-4d8e-94f6-a35e64d3bda7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.055027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] The token cache is being invalidate because project dd11ed3d7bc243a193b91e5e6d6b951a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:09.055318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.055984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.058008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1040/2089] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:08 2022] DELETE /identity/v3/projects/dd11ed3d7bc243a193b91e5e6d6b951a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:09.062078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.063482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:09.089217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438afe2-a27a-4351-86c8-ee3e86f40cdd admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.093969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.094637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.094923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.095209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.095963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.097886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.128835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a781f45-806a-4d8e-94f6-a35e64d3bda7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.134359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.135943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.136253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.136513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] PATH_INFO: `/v3/users/f3e95fdf6be6426a9cd575b4955b02bc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.137962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e95fdf6be6426a9cd575b4955b02bc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.139902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.223874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1050/2090] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:09 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:10:09.227790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.229345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:09.240983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178326cf-a3e3-41ab-ae62-7437dc120d85 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.246196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.246830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.247116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.247393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.248141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.249717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.259470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1051/2091] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:09.264432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.273776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ee903-2438-45dd-b5f3-b29c8748b730 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.278542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.279156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.279443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.279746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.280435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.281972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.292733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1052/2092] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:09.296607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.305754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad66c4-6950-4b34-b689-16b6a8277c23 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.310981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.311829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.312112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.312387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] PATH_INFO: `/v3/projects/c95724edd9644f7b9668cf364d1beed7/users/fb0b1724e0a64e86857002353ea88bb0/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.327134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95724edd9644f7b9668cf364d1beed7, user_id=fb0b1724e0a64e86857002353ea88bb0, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.329795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6d6a-4571-4386-9751-fe615e846a2a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.342390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e95fdf6be6426a9cd575b4955b02bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.343056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e95fdf6be6426a9cd575b4955b02bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.350105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e95fdf6be6426a9cd575b4955b02bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.362535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e95fdf6be6426a9cd575b4955b02bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.438801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1053/2093] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:09 2022] PUT /identity/v3/projects/c95724edd9644f7b9668cf364d1beed7/users/fb0b1724e0a64e86857002353ea88bb0/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:09.448952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.449246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.449531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.465945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e95fdf6be6426a9cd575b4955b02bc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:09.472439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1041/2094] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:09 2022] DELETE /identity/v3/users/f3e95fdf6be6426a9cd575b4955b02bc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:09.475418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] MFA Rules not processed for user `fb0b1724e0a64e86857002353ea88bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:09.476665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:09.517561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:09.540961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1054/2095] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:10:09.552763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:09.554178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:09.575945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:09.612180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7486d-7ce2-4392-a730-ee87b2eba6ab admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:09.615865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:09.616504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:09.616793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:09.617070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:09.625994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:09.627464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:09.636907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1042/2096] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:10.171684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:10.173275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:10.246376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e36c7-c329-4de8-8cd2-7b502c08e080 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:10.251310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:10.252247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:10.252539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:10.252844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] PATH_INFO: `/v3/projects/523a691a476b423580f5e816adc91de1` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:10.254145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523a691a476b423580f5e816adc91de1)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:10.256214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:10.365527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523a691a476b423580f5e816adc91de1', 'request_id': 'req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.453973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523a691a476b423580f5e816adc91de1', 'request_id': 'req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.460171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523a691a476b423580f5e816adc91de1', 'request_id': 'req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.472438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] The token cache is being invalidate because project 523a691a476b423580f5e816adc91de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:10.472853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.473504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.475063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1055/2097] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:10 2022] DELETE /identity/v3/projects/523a691a476b423580f5e816adc91de1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:10.480340 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:10.490230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dc360-861d-46dc-be28-6f7609a086c8 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:10.547189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:10.548959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:10.548959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:10.548959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] PATH_INFO: `/v3/users/54228ae4fccc40279fb718b7986badbe` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:10.549965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54228ae4fccc40279fb718b7986badbe)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:10.551977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:10.789443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54228ae4fccc40279fb718b7986badbe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.790520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54228ae4fccc40279fb718b7986badbe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.799137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54228ae4fccc40279fb718b7986badbe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.814410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54228ae4fccc40279fb718b7986badbe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.892537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-dcc1dec5-5c4d-4609-bc62-32884a270179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54228ae4fccc40279fb718b7986badbe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:10.901651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1043/2098] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:10 2022] DELETE /identity/v3/users/54228ae4fccc40279fb718b7986badbe => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:11.426516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:11.428008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:11.446507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcf9e1-6c4c-4a5f-a152-c0164919c513 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:11.516446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:11.517255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:11.517553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:11.517863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] PATH_INFO: `/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:11.519243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510a5bf59b5b4829ac401a2b51a1f20e)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:11.521265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:11.533989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:11.659768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510a5bf59b5b4829ac401a2b51a1f20e', 'request_id': 'req-d959657f-0962-4a32-a115-acc939efeca1'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:11.733910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510a5bf59b5b4829ac401a2b51a1f20e', 'request_id': 'req-d959657f-0962-4a32-a115-acc939efeca1'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:11.740188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510a5bf59b5b4829ac401a2b51a1f20e', 'request_id': 'req-d959657f-0962-4a32-a115-acc939efeca1'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:11.752369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] The token cache is being invalidate because project 510a5bf59b5b4829ac401a2b51a1f20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:11.752613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:11.753264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d959657f-0962-4a32-a115-acc939efeca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:11.754812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1056/2099] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:11 2022] DELETE /identity/v3/projects/510a5bf59b5b4829ac401a2b51a1f20e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:11.759954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:11.767376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:11.767376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:11.778811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:11.780053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:11.814567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:11.841695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1044/2100] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:11.855925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:11.856256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:11.856532 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:11.875867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:11.877062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:11.886250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1057/2101] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:11.890749 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:11.901301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a36650-92f5-494e-90b9-f653ecffa394 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:11.906518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:11.907256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:11.907636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:11.907996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:11.908908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:11.909514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:11.910855 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:11.922805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1045/2102] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:10:11.927273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:11.936979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5716-d5fd-471e-bb40-a162513435cf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:11.943772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:11.943772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:11.943772 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:11.944039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:11.944639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:11.946531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.099037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1058/2103] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:11 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:12.100187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.110253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b037f-1cf9-4583-9687-9b04b5b8dcac admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.167966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.168632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.168929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.169189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.169880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.171822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.249467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1046/2104] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:12 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:10:12.253569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.265084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba264e-8226-40c8-bac5-a44310532d54 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.269895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.270645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.270975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.271259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.272037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.273633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.284961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1059/2105] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:12.289242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.299873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9bc9-afa2-4a76-9822-94da97457730 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.304446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.305097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.305378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.305654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.306367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.308777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4dd3-8471-4462-b3f9-1c272fcc3a2b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.322782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1047/2106] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:12.323889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.334477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fee65-7d16-43d6-817f-d04b5d20e36d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.339550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.343432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.343432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.343432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] PATH_INFO: `/v3/projects/c6c440914e0f40e49b9fc8ab9f4b6f48/users/593bba746dfc40dfbe768b4b9f0c78e3/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.357290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c440914e0f40e49b9fc8ab9f4b6f48, user_id=593bba746dfc40dfbe768b4b9f0c78e3, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.359983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.477954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1060/2107] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:12 2022] PUT /identity/v3/projects/c6c440914e0f40e49b9fc8ab9f4b6f48/users/593bba746dfc40dfbe768b4b9f0c78e3/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:12.488874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.488874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.488874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.540149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:12.540149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:12.543972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.545833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:12.602714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1048/2108] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:12.609763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6b32-664d-40aa-b4b5-930266c9a89e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.612677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:12.613606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.614021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:12.614262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.614580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.614864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.616652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:12.677965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:12.692596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:12.693218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.694661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dcc2f-1dfe-42ac-9298-eeb155072445 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.697508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3ba76-e82c-4854-931f-e692b45352fd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:12.701564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:12.702211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:12.702498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:12.702775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:12.705074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1061/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:12.712284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:12.714825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:12.724288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1049/2110] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:10:14.088264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077991c-c157-4b5e-8e2e-b82df102610d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:14.088879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077991c-c157-4b5e-8e2e-b82df102610d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:14.089004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077991c-c157-4b5e-8e2e-b82df102610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:14.116519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2077991c-c157-4b5e-8e2e-b82df102610d None None] MFA Rules not processed for user `593bba746dfc40dfbe768b4b9f0c78e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:14.117745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2077991c-c157-4b5e-8e2e-b82df102610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:14.186142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1062/2111] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:14.197264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:14.206734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22911-2924-4884-b95c-5a6b1316bf7f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:14.210586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:14.211224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:14.211506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:14.211804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:14.221110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:14.222586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:14.232530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1050/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:17.016963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899764e2-9805-4b92-8120-d98b1d952df2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:17.017468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899764e2-9805-4b92-8120-d98b1d952df2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:17.017562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899764e2-9805-4b92-8120-d98b1d952df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:17.035812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-899764e2-9805-4b92-8120-d98b1d952df2 None None] MFA Rules not processed for user `593bba746dfc40dfbe768b4b9f0c78e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:17.037014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-899764e2-9805-4b92-8120-d98b1d952df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:17.045096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1063/2113] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:23.969860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:23.971473 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:23.986923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57bc3b-94cd-4fba-b407-99ac2acae651 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:23.991930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:23.992808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:23.993091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:23.993363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] PATH_INFO: `/v3/users/a371874f73ef4e9b8dda465931c5aa3c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:23.994674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a371874f73ef4e9b8dda465931c5aa3c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:23.997730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:24.222839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a371874f73ef4e9b8dda465931c5aa3c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:24.222839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a371874f73ef4e9b8dda465931c5aa3c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:24.227981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a371874f73ef4e9b8dda465931c5aa3c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:24.241637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a371874f73ef4e9b8dda465931c5aa3c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:24.316850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a371874f73ef4e9b8dda465931c5aa3c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:24.327655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1051/2114] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:23 2022] DELETE /identity/v3/users/a371874f73ef4e9b8dda465931c5aa3c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:24.329308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:24.329810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:24.330119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:24.354462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:24.356435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:24.423961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1064/2115] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:24.439259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:24.446330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:24.533881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208bcb0-d9dc-4b5e-b21b-4877ab5e08dc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:24.543994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:24.544776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:24.545216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:24.545496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:24.560042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:24.561571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:24.571725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1052/2116] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:25.205096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:25.206640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:25.231857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99bc02-cda9-4440-89e3-5005f66ee32a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:25.236360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:25.237341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:25.237627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:25.237909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] PATH_INFO: `/v3/projects/f4f67b04272a412986b0a8e374e318cb` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:25.239099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f67b04272a412986b0a8e374e318cb)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:25.241073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:25.340987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f67b04272a412986b0a8e374e318cb', 'request_id': 'req-4905a2a6-e03d-417f-b516-36f75eb8964f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.438389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f67b04272a412986b0a8e374e318cb', 'request_id': 'req-4905a2a6-e03d-417f-b516-36f75eb8964f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.444183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f67b04272a412986b0a8e374e318cb', 'request_id': 'req-4905a2a6-e03d-417f-b516-36f75eb8964f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.445321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:25.456046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] The token cache is being invalidate because project f4f67b04272a412986b0a8e374e318cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:25.456334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.456961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.459865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1065/2117] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:25 2022] DELETE /identity/v3/projects/f4f67b04272a412986b0a8e374e318cb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:25.462467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:25.472520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e71ac-8a40-4528-a111-325f6587db43 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:25.520824 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:25.531423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:25.532317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:25.532600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:25.532875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] PATH_INFO: `/v3/users/b1a2815c1d104e8fb61c12bd966189a5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:25.534042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a2815c1d104e8fb61c12bd966189a5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:25.535976 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:25.738384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a2815c1d104e8fb61c12bd966189a5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.739043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a2815c1d104e8fb61c12bd966189a5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.746442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a2815c1d104e8fb61c12bd966189a5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.758334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a2815c1d104e8fb61c12bd966189a5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.855833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-52e21f22-b716-4728-bd21-77e34101bf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a2815c1d104e8fb61c12bd966189a5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:25.862323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1053/2118] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:25 2022] DELETE /identity/v3/users/b1a2815c1d104e8fb61c12bd966189a5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:26.388190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:26.389872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:26.404416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905a2a6-e03d-417f-b516-36f75eb8964f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:26.461668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:26.462527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:26.462816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:26.463099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] PATH_INFO: `/v3/projects/f2696d0d3dfd4e938ec20470122817da` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:26.464788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2696d0d3dfd4e938ec20470122817da)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:26.467151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:26.570113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2696d0d3dfd4e938ec20470122817da', 'request_id': 'req-fd71ae3e-2cfe-40df-9b65-6db264cf8350'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:26.638148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2696d0d3dfd4e938ec20470122817da', 'request_id': 'req-fd71ae3e-2cfe-40df-9b65-6db264cf8350'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:26.643977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2696d0d3dfd4e938ec20470122817da', 'request_id': 'req-fd71ae3e-2cfe-40df-9b65-6db264cf8350'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:26.654878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] The token cache is being invalidate because project f2696d0d3dfd4e938ec20470122817da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:26.658191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:26.658191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-fd71ae3e-2cfe-40df-9b65-6db264cf8350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:26.658191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1066/2119] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:26 2022] DELETE /identity/v3/projects/f2696d0d3dfd4e938ec20470122817da => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:26.663517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:26.664021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:26.664116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:26.693588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:26.694797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:26.752458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1054/2120] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:26.760555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:26.760847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:26.761128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:26.779640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:26.780832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:26.788582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1067/2121] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:26.793326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:26.803493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8002-9c7c-45b6-8aec-d2ce63fa6460 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:26.808148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:26.809534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:26.809850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:26.810128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:26.810844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:26.811153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:26.812765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:26.824453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1055/2122] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:10:26.828890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:26.838180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e70fe-13a5-4501-8142-d4c10733dcfe None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:26.842828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:26.843475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:26.843787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:26.844061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:26.844739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:26.846612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:26.943363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1068/2123] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:26 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:26.947687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:26.959180 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c733-36aa-4c89-b484-c4d29d43e32b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:27.008006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:27.023862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:27.024607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.024901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.025178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.025920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:27.028721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:27.132961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1056/2124] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:26 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:27.134178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:27.145630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26117a-0f45-40ae-b89e-2f836803ca7d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:27.157036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:27.157956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.158236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.158511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.159265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:27.160947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:27.172325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1069/2125] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:27.176368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:27.189871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe2a22-7c24-4083-89d5-e6aa1eddf0a7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:27.194462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:27.195118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.195403 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.195716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.196432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:27.198013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eedf84-0b5e-49b9-bb93-718d68582214 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:27.208462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1057/2126] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:27.212485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:27.222289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2fe2-c638-4495-819f-2a12dc4e6423 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:27.226779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:27.227701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.227981 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.228254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] PATH_INFO: `/v3/projects/b5b4fada7e374f37961d01a9dd516339/users/b3361abb28fe4bdcbb79f33740f6e515/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.242236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b4fada7e374f37961d01a9dd516339, user_id=b3361abb28fe4bdcbb79f33740f6e515, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:27.244968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:27.353414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1070/2127] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:27 2022] PUT /identity/v3/projects/b5b4fada7e374f37961d01a9dd516339/users/b3361abb28fe4bdcbb79f33740f6e515/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:27.365831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.366128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.366409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.400509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] MFA Rules not processed for user `b3361abb28fe4bdcbb79f33740f6e515`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:27.402040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:27.475400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1058/2128] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:27.485130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:27.487133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:27.510507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:27.546393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4f2-d062-4504-956c-7872244523f6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:27.550683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:27.551332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:27.551710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:27.552553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:27.562078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:27.564385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1de2b-bb66-4dc0-ae53-e1ecc92cd4b7 service glance] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:27.573365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1071/2129] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:29.651637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:29.653875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:29.724900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5ed5-192c-4f9a-afa7-d103fe416dcd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:29.732251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:29.733375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:29.733740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:29.734092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] PATH_INFO: `/v3/users/05ac464eb6624f0abf84b14f299931b3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:29.735566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ac464eb6624f0abf84b14f299931b3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:29.737688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:29.954556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ac464eb6624f0abf84b14f299931b3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:29.955203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ac464eb6624f0abf84b14f299931b3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:29.962055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ac464eb6624f0abf84b14f299931b3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:29.963982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:29.974068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ac464eb6624f0abf84b14f299931b3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:30.089265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ac464eb6624f0abf84b14f299931b3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:30.095727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1059/2130] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:29 2022] DELETE /identity/v3/users/05ac464eb6624f0abf84b14f299931b3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:30.100330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:30.100875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:30.100978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:30.118552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:30.120020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:30.182242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1072/2131] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:30.195849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:30.205938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:30.272266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7357-3ca6-48f7-a680-0a946d497ee5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:30.275922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:30.276610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:30.277184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:30.278128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:30.289087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:30.290629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:30.306947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1060/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:30.851520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:30.853391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:30.866735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239b49-c233-4b58-aebc-e17d05a49f2d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:30.872367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:30.873615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:30.874048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:30.874526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] PATH_INFO: `/v3/projects/bd53114a1ca7475e8fc38781b12804e5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:30.875935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd53114a1ca7475e8fc38781b12804e5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:30.878052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:30.994824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd53114a1ca7475e8fc38781b12804e5', 'request_id': 'req-e3909d37-1863-40e6-92de-8cc5f224e71f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.079439 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd53114a1ca7475e8fc38781b12804e5', 'request_id': 'req-e3909d37-1863-40e6-92de-8cc5f224e71f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.085867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd53114a1ca7475e8fc38781b12804e5', 'request_id': 'req-e3909d37-1863-40e6-92de-8cc5f224e71f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.097819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] The token cache is being invalidate because project bd53114a1ca7475e8fc38781b12804e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:31.098110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.098776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.100473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1073/2133] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:30 2022] DELETE /identity/v3/projects/bd53114a1ca7475e8fc38781b12804e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:31.104510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:31.114841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e727d-9565-4289-9be3-4fde074e55a9 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:31.176096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:31.176970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:31.177254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:31.177530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] PATH_INFO: `/v3/users/27212db027ad4c7dabc2459bd417cb0d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:31.178710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27212db027ad4c7dabc2459bd417cb0d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:31.180671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:31.360061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27212db027ad4c7dabc2459bd417cb0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.360762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27212db027ad4c7dabc2459bd417cb0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.370140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27212db027ad4c7dabc2459bd417cb0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.384003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27212db027ad4c7dabc2459bd417cb0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.439841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-81c2fa33-87ca-4bc5-be29-65391c83cc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27212db027ad4c7dabc2459bd417cb0d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:31.441970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:31.447950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1061/2134] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:31 2022] DELETE /identity/v3/users/27212db027ad4c7dabc2459bd417cb0d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:31.934776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:31.936672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:31.951651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3909d37-1863-40e6-92de-8cc5f224e71f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.006285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:32.033148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.034074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.034356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.034620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] PATH_INFO: `/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.035833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7edc8d7b188e44c0a0c9ac87d3677e53)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.037853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.148654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edc8d7b188e44c0a0c9ac87d3677e53', 'request_id': 'req-6b3cf905-002c-444b-8b15-626f596d2822'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:32.237728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edc8d7b188e44c0a0c9ac87d3677e53', 'request_id': 'req-6b3cf905-002c-444b-8b15-626f596d2822'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:32.244427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edc8d7b188e44c0a0c9ac87d3677e53', 'request_id': 'req-6b3cf905-002c-444b-8b15-626f596d2822'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:32.257726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] The token cache is being invalidate because project 7edc8d7b188e44c0a0c9ac87d3677e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:32.258015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:32.258751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6b3cf905-002c-444b-8b15-626f596d2822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:32.260316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1074/2135] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:31 2022] DELETE /identity/v3/projects/7edc8d7b188e44c0a0c9ac87d3677e53 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:32.266194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.266678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.270054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.285082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:32.286342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:32.354602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1062/2136] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:32.362193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.362563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.362924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.382517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:32.383759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:32.392984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1075/2137] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:32.397252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.407311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efc575-a1a4-4a49-a491-9d236e0a098d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.411909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.412585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.412872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.413150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.413871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:32.414181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.415795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.428236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1063/2138] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:10:32.432277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.442120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff27411-a3df-490a-88e9-c9ba0830d0e6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.446751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.447395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.447710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.447991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.448684 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.451272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.537236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1076/2139] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:32 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:32.541342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.551939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e32d-0aae-4cc3-8acf-9736ca26a6b1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.609030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.609728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.610012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.610430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.611170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.613203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.701034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1064/2140] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:32 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:32.704232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.715673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e11cbc-02aa-4ace-9ab4-d2777a5188a1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.720641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.721366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.721633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.721916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.722645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.724334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.735789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1077/2141] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:32.741355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.751872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a257-3838-4139-9075-780de571811c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.756774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.757439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.761613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.761613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.761613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.761613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824bbfc-9622-477c-8e82-a1e7600e56dc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.770992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1065/2142] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:32.775423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:32.786457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466a84-9c8c-4990-995a-973ead888fe8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:32.791191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:32.792109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.792392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.792671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] PATH_INFO: `/v3/projects/4aa89204a237441a808a1ec0553126d9/users/eb301706be4c47b990163b4870559360/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.807674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa89204a237441a808a1ec0553126d9, user_id=eb301706be4c47b990163b4870559360, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:32.818369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:32.928116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1078/2143] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:32 2022] PUT /identity/v3/projects/4aa89204a237441a808a1ec0553126d9/users/eb301706be4c47b990163b4870559360/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:32.936006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:32.936301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:32.936582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:32.971458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] MFA Rules not processed for user `eb301706be4c47b990163b4870559360`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:32.972863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:33.030244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:33.039909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1066/2144] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:10:33.045368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.113149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c35c4b-2360-4801-a487-9202061d0ba5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.117800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.118536 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.118819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.119094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.119819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.121798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.194778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:33.203249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1079/2145] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:33 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:10:33.207513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.222043 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0ef8-3023-4d9f-9cdc-0cfea14590ad None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.289004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.289843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.290133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.290414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.291157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.293869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.372263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1067/2146] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:33 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:33.373581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.400527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca7a-59a1-4dc1-b8c9-17e7c70fcb71 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.406600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.407399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.407879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.408409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.409153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.410970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.424029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1080/2147] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:10:33.428432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.440046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e6e17-d460-478a-96f0-4da0e07cf4f6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.447240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.447240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.447240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.447240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] PATH_INFO: `/v3/projects/4117796bc14b47c0a9d7921d643072e5/users/768df7bcee3849338dc1dafb4aae52f4/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.463391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4117796bc14b47c0a9d7921d643072e5, user_id=768df7bcee3849338dc1dafb4aae52f4, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.471660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.587933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1068/2148] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:33 2022] PUT /identity/v3/projects/4117796bc14b47c0a9d7921d643072e5/users/768df7bcee3849338dc1dafb4aae52f4/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:33.589261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.600660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2740-80f5-4c02-a0bf-6fcca042a01e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.664957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.665628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.665915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.666197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.666958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.669349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efb50-ac1d-4b50-bf3d-3516291855af admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.679193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1081/2149] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:33.683321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.694175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae2b3d-98fe-4780-8770-533dd6e5078e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.698970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.699981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.700284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.700561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] PATH_INFO: `/v3/projects/4117796bc14b47c0a9d7921d643072e5/users/768df7bcee3849338dc1dafb4aae52f4/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.702637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4117796bc14b47c0a9d7921d643072e5, user_id=768df7bcee3849338dc1dafb4aae52f4, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.705300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.716121 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1069/2150] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:33 2022] PUT /identity/v3/projects/4117796bc14b47c0a9d7921d643072e5/users/768df7bcee3849338dc1dafb4aae52f4/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:33.727211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.727510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.727825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.764927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] MFA Rules not processed for user `768df7bcee3849338dc1dafb4aae52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:33.767489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:33.855662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1082/2151] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:33.867318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:33.870041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:33.951154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc859-71f0-4143-a42d-776222228aa5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:33.954644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:33.955312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:33.955628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:33.956054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:33.970101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:33.971948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:33.984310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1070/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:35.061396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:35.063396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:35.075377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c84a21-687d-451a-a354-b93420a7f867 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:35.079461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:35.080141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:35.080456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:35.080734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:35.144543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:35.145972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0029fb6-30fe-419d-b797-145a1f77353f service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:35.156111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1083/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:38.328636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:38.379440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:38.393913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad3b1-2520-4f5f-bc15-ebc030b6cb20 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:38.399464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:38.400444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:38.400736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:38.401051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] PATH_INFO: `/v3/users/eb301706be4c47b990163b4870559360` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:38.402310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb301706be4c47b990163b4870559360)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:38.405067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:38.635288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb301706be4c47b990163b4870559360'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:38.636045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb301706be4c47b990163b4870559360'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:38.646500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb301706be4c47b990163b4870559360'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:38.659867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb301706be4c47b990163b4870559360'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:38.760499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb301706be4c47b990163b4870559360'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:38.768598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1071/2154] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:38 2022] DELETE /identity/v3/users/eb301706be4c47b990163b4870559360 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:10:38.773625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:38.774133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:38.774242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:38.786634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:38.793569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:38.795428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:38.875830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1084/2155] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:10:38.886721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:38.888402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:38.962261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ee4f-bca0-4481-ae12-82c8e363edd5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:38.973158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:38.974211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:38.974721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:38.975184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:38.986579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:38.988365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:38.999911 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1072/2156] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:39.402182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:39.403680 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:39.421306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384ff24-05b9-4ca0-aa49-06d30dde7ea2 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:39.426553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:39.427256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:39.428035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:39.428852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] PATH_INFO: `/v3/projects/4aa89204a237441a808a1ec0553126d9` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:39.430010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa89204a237441a808a1ec0553126d9)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:39.431934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:39.537585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa89204a237441a808a1ec0553126d9', 'request_id': 'req-6a63b62d-cf3d-4163-a934-86ffe04e25ff'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.577845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa89204a237441a808a1ec0553126d9', 'request_id': 'req-6a63b62d-cf3d-4163-a934-86ffe04e25ff'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.584174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa89204a237441a808a1ec0553126d9', 'request_id': 'req-6a63b62d-cf3d-4163-a934-86ffe04e25ff'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.596428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] The token cache is being invalidate because project 4aa89204a237441a808a1ec0553126d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:39.596720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.597355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.598936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1085/2157] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:39 2022] DELETE /identity/v3/projects/4aa89204a237441a808a1ec0553126d9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:39.603175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:39.614722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd40d9-3729-4aa3-b931-a15018f14636 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:39.675177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:39.676072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:39.676354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:39.676627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] PATH_INFO: `/v3/users/768df7bcee3849338dc1dafb4aae52f4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:39.677807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768df7bcee3849338dc1dafb4aae52f4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:39.680383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:39.693264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:39.877408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768df7bcee3849338dc1dafb4aae52f4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.878064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768df7bcee3849338dc1dafb4aae52f4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.886257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768df7bcee3849338dc1dafb4aae52f4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:39.900463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768df7bcee3849338dc1dafb4aae52f4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.000727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9ebcde96-0055-424d-9350-342678cf7d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768df7bcee3849338dc1dafb4aae52f4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.007448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1073/2158] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:10:39 2022] DELETE /identity/v3/users/768df7bcee3849338dc1dafb4aae52f4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:40.453563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:40.454796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:40.467409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b62d-cf3d-4163-a934-86ffe04e25ff admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:40.532578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:40.533441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:40.533728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:40.534007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] PATH_INFO: `/v3/projects/4117796bc14b47c0a9d7921d643072e5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:40.535186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4117796bc14b47c0a9d7921d643072e5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:40.537125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:40.651012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:40.663385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4117796bc14b47c0a9d7921d643072e5', 'request_id': 'req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.725064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4117796bc14b47c0a9d7921d643072e5', 'request_id': 'req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.732917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4117796bc14b47c0a9d7921d643072e5', 'request_id': 'req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.745112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] The token cache is being invalidate because project 4117796bc14b47c0a9d7921d643072e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:10:40.745404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.746067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-64ff7eea-fb6b-410b-a56b-ac91b77e4e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:10:40.747726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1086/2159] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:10:40 2022] DELETE /identity/v3/projects/4117796bc14b47c0a9d7921d643072e5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:40.753256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:40.755124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:40.755124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:40.778482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:40.783790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:40.858925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1074/2160] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:40.866779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:40.867078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:40.867375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:40.887864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:40.889090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:40.898456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1087/2161] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:10:40.902836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:40.917033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a40a7-2fab-4541-887c-f3099eea197a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:40.930848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:40.931555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:40.931948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:40.932145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:40.932877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:10:40.933165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:40.934802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:40.955876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1075/2162] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:10:40.959754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:40.971385 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6852-21da-4019-a3a9-e7737b2a8c53 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:40.976666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:40.977266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:40.977550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:40.977833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:40.978538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:40.980484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.086443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1088/2163] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:10:40 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:41.090397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:41.101028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11f023-4951-4fdd-ad17-840d9077cb37 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:41.161460 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:41.162144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.162420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.162702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.163399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:41.165344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.251248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1076/2164] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:10:41 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:10:41.252585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:41.263236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62657-b869-47ed-9fa9-6cbbd275ea76 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:41.268435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:41.269229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.269515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.269790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.273171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:41.273171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.284600 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1089/2165] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:41.291573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:41.312385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdf4c-0c4f-423e-85f2-449e665be297 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:41.326546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:41.327415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.327754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.328030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.328798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:41.330410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f3f9-0121-4e63-8a2f-05a4321d1228 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.332113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:41.343156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1077/2166] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:10:41.347642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:41.358111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8069fb-1de6-48e2-96ce-fe9d759e8951 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:41.364068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:41.365138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.369962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.369962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] PATH_INFO: `/v3/projects/29d05db1993e4130a26c29639416f927/users/e49d66f4cda54e95a54821a2984a84fe/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.384883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d05db1993e4130a26c29639416f927, user_id=e49d66f4cda54e95a54821a2984a84fe, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:41.387553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.487344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1090/2167] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:10:41 2022] PUT /identity/v3/projects/29d05db1993e4130a26c29639416f927/users/e49d66f4cda54e95a54821a2984a84fe/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:10:41.507309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72963f-1901-4556-a1a7-98fd3a1b72c5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.507309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72963f-1901-4556-a1a7-98fd3a1b72c5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.507309 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72963f-1901-4556-a1a7-98fd3a1b72c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.534358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2e72963f-1901-4556-a1a7-98fd3a1b72c5 None None] MFA Rules not processed for user `e49d66f4cda54e95a54821a2984a84fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:41.535688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2e72963f-1901-4556-a1a7-98fd3a1b72c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:41.614299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1078/2168] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:41.626211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:10:41.628098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:41.727911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fd7f2-c5f0-457e-9c37-9385de1556e0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:10:41.732049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:10:41.733697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:41.734212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:41.734604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:41.745756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:10:41.747379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4ad69-f71f-4f85-ae45-f83b96c42cae service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:10:41.757559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1091/2169] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:10:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:10:46.448600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:46.449103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:46.449200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:46.467193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] MFA Rules not processed for user `e8410e3632ec4908824d336fff667da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:46.468417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:46.523200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1079/2170] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:51.191480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014aaf-c515-4016-b99d-9a85c7697afb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:10:51.192108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014aaf-c515-4016-b99d-9a85c7697afb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:10:51.192108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014aaf-c515-4016-b99d-9a85c7697afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:10:51.210729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-62014aaf-c515-4016-b99d-9a85c7697afb None None] MFA Rules not processed for user `9c620175b84d4cee9aef398864c03c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:10:51.211995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-62014aaf-c515-4016-b99d-9a85c7697afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:10:51.247450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:51.269819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1092/2171] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:10:56.515099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=59 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:01.406522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:12.565924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:12.632161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bc1c-c7d2-4e01-bdf3-f146584255ca None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:12.636943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:12.637819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:12.638107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:12.638430 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] PATH_INFO: `/v3/users/e49d66f4cda54e95a54821a2984a84fe` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:12.639870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49d66f4cda54e95a54821a2984a84fe)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:12.641832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:12.841265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49d66f4cda54e95a54821a2984a84fe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:12.841915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49d66f4cda54e95a54821a2984a84fe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:12.849861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49d66f4cda54e95a54821a2984a84fe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:12.861680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49d66f4cda54e95a54821a2984a84fe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:12.936785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49d66f4cda54e95a54821a2984a84fe'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:12.944052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1080/2172] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:12 2022] DELETE /identity/v3/users/e49d66f4cda54e95a54821a2984a84fe => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:12.948549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:12.948997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:12.949223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:12.967564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:12.968754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:13.031514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1093/2173] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:13.042014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:13.043501 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:13.102346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1dea-502d-4d6d-b360-77bcb4666278 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:13.106027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:13.106699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:13.107292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:13.107589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:13.117888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:13.119322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702752e2-6cfe-4d38-98fd-c2515008829a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:13.129301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1081/2174] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:13.709876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:13.712103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:13.727958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6685601-4d4b-4017-976d-9e7908149fe1 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:13.734289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:13.735482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:13.736132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:13.736244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] PATH_INFO: `/v3/projects/29d05db1993e4130a26c29639416f927` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:13.737483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d05db1993e4130a26c29639416f927)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:13.739576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:13.912838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d05db1993e4130a26c29639416f927', 'request_id': 'req-e5032085-ba74-4175-ad39-e8f8acfa8ad7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:13.979815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d05db1993e4130a26c29639416f927', 'request_id': 'req-e5032085-ba74-4175-ad39-e8f8acfa8ad7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:13.987090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d05db1993e4130a26c29639416f927', 'request_id': 'req-e5032085-ba74-4175-ad39-e8f8acfa8ad7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:13.999449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] The token cache is being invalidate because project 29d05db1993e4130a26c29639416f927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:13.999768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:14.000625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e5032085-ba74-4175-ad39-e8f8acfa8ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:14.002147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1094/2175] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:13 2022] DELETE /identity/v3/projects/29d05db1993e4130a26c29639416f927 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:14.007253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.007777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.012230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.027814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:14.029109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:14.046591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:14.088755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1082/2176] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:14.096487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.096782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.097059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.116797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:14.118028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:14.125933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1095/2177] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:14.130258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.140599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4da9-666a-4766-944b-1fbc7379f1c0 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.145322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.146131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.146427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.146774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.147750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:11:14.148067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.149662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.162680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1083/2178] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:11:14.166039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.175495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333681ee-ee14-4208-b2ea-8454c4c1d660 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.181063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.181710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.181991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.182292 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.182987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.184973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.280814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1096/2179] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:11:14 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:11:14.284693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.310454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c6fe-ab69-4b32-8f7b-bd062e61bcb6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.384764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.385567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.385922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.386270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.387039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.389678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.529293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1084/2180] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:11:14 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:14.530725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.541654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c1d69-d4d1-48a5-8430-efba015fcb0e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.546853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.547858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.548273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.548650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.549435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.551258 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.567149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1097/2181] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:11:14.569084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.579435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ece40d-d384-4c43-815a-88986c9454c6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.595199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.595948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.596231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.596573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.597272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.598893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9d33-29b9-4e64-acaf-4cb0e1f15c00 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.610207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1085/2182] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:14.616977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.624971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ad73-7e43-458b-b535-d6be928be65c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.629771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.631985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.636152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.636152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] PATH_INFO: `/v3/projects/583e03cfb61c45c284ab4eb7113f64f3/users/5f12328c5bfd4e9cb992315fbb072c77/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.664415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=583e03cfb61c45c284ab4eb7113f64f3, user_id=5f12328c5bfd4e9cb992315fbb072c77, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.667951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.779112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1098/2183] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:14 2022] PUT /identity/v3/projects/583e03cfb61c45c284ab4eb7113f64f3/users/5f12328c5bfd4e9cb992315fbb072c77/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:11:14.790103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681654-0009-4475-84b6-38a2321ec015 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.790401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681654-0009-4475-84b6-38a2321ec015 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.790686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681654-0009-4475-84b6-38a2321ec015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.826302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8b681654-0009-4475-84b6-38a2321ec015 None None] MFA Rules not processed for user `5f12328c5bfd4e9cb992315fbb072c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:14.827522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b681654-0009-4475-84b6-38a2321ec015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:14.891728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1086/2184] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:14.905823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:14.905823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:14.931830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:14.968454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a140ac-2a2c-4eb5-a5b6-b02d8d603ebb admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:14.972279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:14.972927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:14.973212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:14.973488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:14.982253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:14.983718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:14.993020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1099/2185] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:15.189871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:15.190388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:15.190573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:15.218255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:15.250644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:15.251995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:15.324686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1087/2186] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:15.366510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:15.367901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:15.490643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d12a-64dc-4d4a-8186-68b960b0f70a service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:15.497805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:15.498459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:15.498742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:15.499022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:15.512344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:15.512344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:15.520923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1100/2187] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:11:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:11:21.725860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:21.768647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:21.770313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:21.828463 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad02f-599f-472b-8b3b-45dd96e88521 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:21.850031 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:21.850968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:21.851320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:21.851709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] PATH_INFO: `/v3/users/5f12328c5bfd4e9cb992315fbb072c77` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:21.855565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f12328c5bfd4e9cb992315fbb072c77)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:21.856873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:21.860338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c287-2733-4dd6-b900-cb6e09a8ddd1 service swift] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:21.867317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:21.869124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:21.869679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:21.869964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] PATH_INFO: `/v3/users/fb0b1724e0a64e86857002353ea88bb0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:21.871617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0b1724e0a64e86857002353ea88bb0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:21.876044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:22.521556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f12328c5bfd4e9cb992315fbb072c77'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.527692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f12328c5bfd4e9cb992315fbb072c77'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.530502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f12328c5bfd4e9cb992315fbb072c77'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.543139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f12328c5bfd4e9cb992315fbb072c77'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.545784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:22.634003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:22.646115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0b1724e0a64e86857002353ea88bb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.650014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0b1724e0a64e86857002353ea88bb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.669969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3cb24c88-db92-4797-b67b-c5c1e2e5f8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f12328c5bfd4e9cb992315fbb072c77'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.680182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1088/2188] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:21 2022] DELETE /identity/v3/users/5f12328c5bfd4e9cb992315fbb072c77 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:22.687570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:22.687863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:22.688150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:22.711841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:22.713534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:22.763334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0b1724e0a64e86857002353ea88bb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.791186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0b1724e0a64e86857002353ea88bb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.797894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1089/2189] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:22.806157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-73201cc3-d4df-4085-9424-b97799028c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0b1724e0a64e86857002353ea88bb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:22.810719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:22.812616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:22.831493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1101/2190] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:21 2022] DELETE /identity/v3/users/fb0b1724e0a64e86857002353ea88bb0 => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:11:22.852662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:22.857428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:22.857428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:22.900915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:22.914688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:22.927333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcafd0c-e3c3-4494-9045-dd6c788ff2b1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:23.023468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1102/2191] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:23.033429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:23.034531 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:23.034891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:23.035336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:23.039831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:23.051459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:23.056468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:23.062683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6618-e3be-4d45-9def-8e4c4ff86849 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:23.065108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:23.065896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:23.066286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:23.066675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:23.074549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1090/2192] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:11:23.098111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:23.099630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:23.129731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1103/2193] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:23.831828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:23.833956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:23.888972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f619f7-5151-4d89-bb13-f92d32099d23 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:23.896948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:23.898776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:23.899329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:23.899636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] PATH_INFO: `/v3/projects/c95724edd9644f7b9668cf364d1beed7` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:23.910768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95724edd9644f7b9668cf364d1beed7)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:23.919990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:23.977218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:23.979393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:24.005694 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5459-212d-4230-a8b6-99b4674745cd service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:24.017987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:24.019986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:24.020353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:24.020800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] PATH_INFO: `/v3/projects/583e03cfb61c45c284ab4eb7113f64f3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:24.024220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583e03cfb61c45c284ab4eb7113f64f3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:24.029274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:24.092448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:24.093772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95724edd9644f7b9668cf364d1beed7', 'request_id': 'req-896e1ba0-9425-4bd3-84cd-f828b397b4e7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.106724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95724edd9644f7b9668cf364d1beed7', 'request_id': 'req-896e1ba0-9425-4bd3-84cd-f828b397b4e7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.229736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95724edd9644f7b9668cf364d1beed7', 'request_id': 'req-896e1ba0-9425-4bd3-84cd-f828b397b4e7'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.230545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583e03cfb61c45c284ab4eb7113f64f3', 'request_id': 'req-40f2faf8-207d-46e9-adba-4dff57f37256'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.257757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] The token cache is being invalidate because project c95724edd9644f7b9668cf364d1beed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:24.258307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.260298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-896e1ba0-9425-4bd3-84cd-f828b397b4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.262909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1091/2194] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:23 2022] DELETE /identity/v3/projects/c95724edd9644f7b9668cf364d1beed7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:24.325153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583e03cfb61c45c284ab4eb7113f64f3', 'request_id': 'req-40f2faf8-207d-46e9-adba-4dff57f37256'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.364028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583e03cfb61c45c284ab4eb7113f64f3', 'request_id': 'req-40f2faf8-207d-46e9-adba-4dff57f37256'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.407803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] The token cache is being invalidate because project 583e03cfb61c45c284ab4eb7113f64f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:24.408117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.408861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-40f2faf8-207d-46e9-adba-4dff57f37256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:24.415408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1104/2195] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:23 2022] DELETE /identity/v3/projects/583e03cfb61c45c284ab4eb7113f64f3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:24.421402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:24.421402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:24.421402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:24.452690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:24.454029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:24.615041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1092/2196] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:24.626599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:24.630359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:24.630359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:24.668580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:24.672890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:24.690026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1105/2197] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:24.691291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:24.705734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c98c4-cfb1-46e6-affe-102391795d48 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:24.713128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:24.713968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:24.714265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:24.714548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:24.715464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:11:24.715808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:24.718205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:24.753744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1093/2198] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:11:24.754880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:24.767511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965937b-ed4b-4011-81c9-c6e3fe73d011 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:24.782050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:24.782802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:24.783093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:24.783376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:24.784167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:24.787032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:24.825874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:24.932408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1106/2199] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:11:24 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:24.936559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:24.954912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e3b8-613b-41fc-a95e-d9253768ed47 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:25.104175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:25.108441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.108743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.109040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.109794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:25.111815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:25.232062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1094/2200] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:11:24 2022] POST /identity/v3/users => generated 287 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:25.232743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:25.252377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6cd24-75f6-469f-a417-7e704770a783 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:25.267699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:25.268367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.268662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.268946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.280037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:25.281876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:25.296920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1107/2201] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:25.300771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:25.317362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc298-3368-4caf-94e2-be586fbc1feb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:25.328336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:25.329853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.340553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.342069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.342985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:25.344803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc885-ba1a-4d23-9b32-32c6ffd0f5ba admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:25.368497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1095/2202] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:25.370282 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:25.384164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1eefed-6bc4-45e4-a01d-331cea5632ea admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:25.390537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:25.391611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.392005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.392407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] PATH_INFO: `/v3/projects/0dedb660733d41eea2f4e447363f30d5/users/015e58ce1668444eb056ec89e161ca99/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.419773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dedb660733d41eea2f4e447363f30d5, user_id=015e58ce1668444eb056ec89e161ca99, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:25.422992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:25.532418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1108/2203] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:25 2022] PUT /identity/v3/projects/0dedb660733d41eea2f4e447363f30d5/users/015e58ce1668444eb056ec89e161ca99/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:25.543034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.543335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.543676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.589659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] MFA Rules not processed for user `015e58ce1668444eb056ec89e161ca99`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:25.590897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:25.645366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:25.707227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1096/2204] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:25.719200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:25.721155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:25.829990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1586b4-acc8-41a6-8f93-09c885c0c40e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:25.835509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:25.836492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:25.836862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:25.837235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:25.847722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:25.853618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a666b23-a0a0-403a-bbd8-2069ca6f24e2 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:25.874852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1109/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:25.896678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:26.013997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f51104-9d75-44be-9e0f-27c650934e06 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:26.021564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:26.024525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:26.025022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:26.025648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] PATH_INFO: `/v3/users/015e58ce1668444eb056ec89e161ca99` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:26.027236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015e58ce1668444eb056ec89e161ca99)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:26.029756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:26.284162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015e58ce1668444eb056ec89e161ca99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:26.285142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015e58ce1668444eb056ec89e161ca99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:26.301082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015e58ce1668444eb056ec89e161ca99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:26.320145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015e58ce1668444eb056ec89e161ca99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:26.412419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015e58ce1668444eb056ec89e161ca99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:26.435805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1097/2206] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:25 2022] DELETE /identity/v3/users/015e58ce1668444eb056ec89e161ca99 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:26.440286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:26.440729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:26.440893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:26.465228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:26.467295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:26.566779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1110/2207] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:26.605706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:26.607259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:26.741258 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9dec-5595-4eb4-b8e7-79d7f87f16b7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:26.759412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:26.760107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:26.760393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:26.760669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:26.771386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:26.777454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:26.780084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:26.796464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1098/2208] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:27.658522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:27.660270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:27.680927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa4f2-a708-48a2-8226-42480128b46b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:27.686847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:27.687871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:27.688232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:27.688590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] PATH_INFO: `/v3/projects/0dedb660733d41eea2f4e447363f30d5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:27.689879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dedb660733d41eea2f4e447363f30d5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:27.692065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:27.865184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dedb660733d41eea2f4e447363f30d5', 'request_id': 'req-1841ce77-22fa-40cf-993b-1eebb59de758'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:27.961186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dedb660733d41eea2f4e447363f30d5', 'request_id': 'req-1841ce77-22fa-40cf-993b-1eebb59de758'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:27.966240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:27.976657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dedb660733d41eea2f4e447363f30d5', 'request_id': 'req-1841ce77-22fa-40cf-993b-1eebb59de758'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:27.998983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:28.000548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:28.005775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] The token cache is being invalidate because project 0dedb660733d41eea2f4e447363f30d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:28.006083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.006846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1841ce77-22fa-40cf-993b-1eebb59de758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.021209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cfe97-662a-491c-9df0-3f58aa72ad3e service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:28.023686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1111/2209] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:27 2022] DELETE /identity/v3/projects/0dedb660733d41eea2f4e447363f30d5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:28.096743 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:28.098156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:28.098591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:28.098878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] PATH_INFO: `/v3/users/b3361abb28fe4bdcbb79f33740f6e515` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:28.100692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3361abb28fe4bdcbb79f33740f6e515)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:28.102820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:28.287385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3361abb28fe4bdcbb79f33740f6e515'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.288310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3361abb28fe4bdcbb79f33740f6e515'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.296356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3361abb28fe4bdcbb79f33740f6e515'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.315179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3361abb28fe4bdcbb79f33740f6e515'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.422862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3361abb28fe4bdcbb79f33740f6e515'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:28.430519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1099/2210] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:27 2022] DELETE /identity/v3/users/b3361abb28fe4bdcbb79f33740f6e515 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:28.437912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:28.438250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:28.438580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:28.457132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:28.458346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:28.528008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1112/2211] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:28.537553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:28.539757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:28.597028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc482ecf-b559-438a-a2d0-4341c0fc2a63 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:28.601168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:28.601885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:28.602213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:28.602488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:28.611966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:28.613395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f6a8-d00f-49cf-bb96-dbf31cb8549c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:28.623273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1100/2212] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:29.064324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.065839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:29.078131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79203d-fa04-4063-8ba7-f4fe88983b5d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.082953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.083861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.084151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.084429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] PATH_INFO: `/v3/projects/b5b4fada7e374f37961d01a9dd516339` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.085893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b4fada7e374f37961d01a9dd516339)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.087891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.212539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b4fada7e374f37961d01a9dd516339', 'request_id': 'req-d351c88d-7bc8-4247-a0c9-057a948d7d08'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:29.321566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b4fada7e374f37961d01a9dd516339', 'request_id': 'req-d351c88d-7bc8-4247-a0c9-057a948d7d08'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:29.327762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b4fada7e374f37961d01a9dd516339', 'request_id': 'req-d351c88d-7bc8-4247-a0c9-057a948d7d08'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:29.338880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] The token cache is being invalidate because project b5b4fada7e374f37961d01a9dd516339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:29.339178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:29.339826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d351c88d-7bc8-4247-a0c9-057a948d7d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:29.341559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1113/2213] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:29 2022] DELETE /identity/v3/projects/b5b4fada7e374f37961d01a9dd516339 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:29.346339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.346837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.346953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.365288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:29.367090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:29.376563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:29.427557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1101/2214] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:11:29.436086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.436381 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.436663 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.457548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:29.458765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:29.467088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1114/2215] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:29.471432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.481154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd85b2-9748-4303-882d-6d1bce3053e8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.485763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.486707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.487189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.487859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.488593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:11:29.488903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.490506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.505941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1102/2216] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:11:29.507568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.516811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085fa6d-1029-4133-a971-fe15311052d7 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.521645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.522820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.523122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.523399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.524127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.526299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.604121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1115/2217] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:11:29 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:11:29.607423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.618148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec461f1-147a-4f50-9ef3-974ef1cf903b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.677518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.679275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.680459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.682066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.682837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.684822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.783915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1103/2218] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:11:29 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:29.788712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.799879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91534d4a-646f-4867-af82-56b281e1cb47 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.805264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.805941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.806259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.806539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.807270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.808944 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.820197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1116/2219] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:29.824341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.834714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc7661-11ce-4586-b4cf-004edb154d7e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.840265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.840931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.841222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.841505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.842237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.843918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b85ec-f24a-4c69-9de1-d6f68ca9f3df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.854104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1104/2220] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:29.858333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:29.868415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a913-6cac-4571-a22e-4e639bb73449 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:29.873207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:29.874192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.874479 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.874756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] PATH_INFO: `/v3/projects/4284edf68d154348a7dc7de2f6c4e3e8/users/d906e6a6987847a79bb76ca994c15186/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:29.890419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4284edf68d154348a7dc7de2f6c4e3e8, user_id=d906e6a6987847a79bb76ca994c15186, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:29.893403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:29.979375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1117/2221] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:29 2022] PUT /identity/v3/projects/4284edf68d154348a7dc7de2f6c4e3e8/users/d906e6a6987847a79bb76ca994c15186/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:29.989664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:29.989954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:29.990232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:30.025707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] MFA Rules not processed for user `d906e6a6987847a79bb76ca994c15186`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:30.026952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:30.092860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1105/2222] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:30.103240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:30.105008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:30.111580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:30.162730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944201f2-2da1-42e9-8889-bf88ac965b42 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:30.166575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:30.167221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:30.167511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:30.167821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:30.176109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:30.178299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5a858-9ae6-4ab6-b00a-d59c55720333 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:30.187615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1118/2223] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:30.702446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:30.704324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:30.725991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:30.813213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cecfcc-2408-4e51-9f68-d61ae4897474 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:30.819957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:30.820844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:30.821162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:30.825490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:30.825490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:30.836804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:30.838653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b124d34-79dd-40ad-b55c-459b73574422 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:30.849678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1106/2224] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:38.623798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:38.624311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:38.625514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:38.626174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1119/2225] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:11:38.632179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e233d2-d37e-46ea-8f0f-fb9dad0fa7c2 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:38.632637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e233d2-d37e-46ea-8f0f-fb9dad0fa7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:38.632746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e233d2-d37e-46ea-8f0f-fb9dad0fa7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:38.688693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b0e233d2-d37e-46ea-8f0f-fb9dad0fa7c2 None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:38.690010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b0e233d2-d37e-46ea-8f0f-fb9dad0fa7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:38.771573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1107/2226] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:11:38.784377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:38.786071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:38.883629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46de1a0-7e0a-44fb-937e-c65ea39dc3ae None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:38.888693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:38.889344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:38.889635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:38.889911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:38.917714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:38.917714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29db4c4-14e1-4f88-a4fc-e5fc11de0a37 service glance] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:38.917714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1120/2227] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:39.125450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.125750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.126035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.127440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1108/2228] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:11:39.132474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93882-d133-4e18-9883-83db83d039cf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.132768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93882-d133-4e18-9883-83db83d039cf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.133390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d93882-d133-4e18-9883-83db83d039cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.153999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-87d93882-d133-4e18-9883-83db83d039cf None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:39.155416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-87d93882-d133-4e18-9883-83db83d039cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:39.215070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1121/2229] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:11:39.228438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:39.230254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:39.244118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856c9f-b51c-45a9-93f7-fd100ad6b7e9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:39.247891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:39.248559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.248849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.249124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.257525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:39.259930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9d6f4-ba50-4bd4-ac96-5e8741cff45e service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:39.269109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1109/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:39.386673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332b72-5f12-4d19-8850-2ea12aed93d9 None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.386863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332b72-5f12-4d19-8850-2ea12aed93d9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.387242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332b72-5f12-4d19-8850-2ea12aed93d9 None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.388534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1122/2231] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:11:39.394073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.394372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.394653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.414144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:39.415554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:39.424700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1110/2232] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:39.435429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332b72-5f12-4d19-8850-2ea12aed93d9 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:39.448589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332b72-5f12-4d19-8850-2ea12aed93d9 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:39.452351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:39.453111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:39.453401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:39.453790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:39.465577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:39.467002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694957f8-219f-4429-b6d7-888dc1161545 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:39.478588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1123/2233] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:46.906172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:46.932860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:46.974598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f5b0-af8f-4310-880c-98d84109b96f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:46.980497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:46.981358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:46.981644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:46.981924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] PATH_INFO: `/v3/users/d906e6a6987847a79bb76ca994c15186` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:46.983099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d906e6a6987847a79bb76ca994c15186)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:46.985037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:47.059658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:47.060121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:47.060397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:47.078675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:47.079918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:47.100640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:47.136957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1124/2234] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:11:47.151493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:47.153462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:47.223171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2faea0-d371-442e-bd04-519b9385e05b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:47.228236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:47.228927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:47.229210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:47.229487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:47.237438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:47.239052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d020aef-5643-4525-a8f0-c442b48cdcec service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:47.247075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1125/2235] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:11:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:11:47.383102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd906e6a6987847a79bb76ca994c15186'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:47.384583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd906e6a6987847a79bb76ca994c15186'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:47.392192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd906e6a6987847a79bb76ca994c15186'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:47.405051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd906e6a6987847a79bb76ca994c15186'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:47.478177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd906e6a6987847a79bb76ca994c15186'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:47.493772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1111/2236] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:11:46 2022] DELETE /identity/v3/users/d906e6a6987847a79bb76ca994c15186 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:47.498424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:47.498756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:47.504821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:47.520490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:47.522634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:47.601055 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1126/2237] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:47.611746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:47.613185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:47.679805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74efa5-2cb0-4db0-8a13-d5e40e1c67fc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:47.684401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:47.685058 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:47.685398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:47.685676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:47.707395 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:47.708975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cfc3-dad8-43fa-b27b-f4ff5359d06a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:47.721680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1112/2238] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:48.188808 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.191015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:48.211264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d33c3e-0271-40a7-bb0b-61d56a0cebce None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.211264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.211264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.211264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.211643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] PATH_INFO: `/v3/projects/4284edf68d154348a7dc7de2f6c4e3e8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.211643 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4284edf68d154348a7dc7de2f6c4e3e8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.214209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:48.325626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4284edf68d154348a7dc7de2f6c4e3e8', 'request_id': 'req-134fec32-ffcc-49ef-85a4-477ac90f39f3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:48.380628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4284edf68d154348a7dc7de2f6c4e3e8', 'request_id': 'req-134fec32-ffcc-49ef-85a4-477ac90f39f3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:48.382666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:48.388554 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4284edf68d154348a7dc7de2f6c4e3e8', 'request_id': 'req-134fec32-ffcc-49ef-85a4-477ac90f39f3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:48.400852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] The token cache is being invalidate because project 4284edf68d154348a7dc7de2f6c4e3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:11:48.401086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:48.401696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-134fec32-ffcc-49ef-85a4-477ac90f39f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:11:48.403789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1127/2239] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:11:48 2022] DELETE /identity/v3/projects/4284edf68d154348a7dc7de2f6c4e3e8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:48.408801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.409316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.409422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.429595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:48.433067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:48.500362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:48.520808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1113/2240] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:48.529409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.529705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.529991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.548657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:48.549875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:48.565195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1128/2241] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:48.569872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.584164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7af59c-f3d1-4e54-ad36-ef403dfc10ce None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.601872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.602926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.603399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.603825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.604792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:11:48.605175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.606965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:48.623566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1114/2242] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:11:48.625229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.635710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2c2fe-2c8a-43d3-a33c-f8721e74d0ab None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.640498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.641191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.641492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.641776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.642511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.644456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:48.742347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1129/2243] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:11:48 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:48.746549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.756885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1458-e220-431b-8713-a64ad08d4895 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.825394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.825394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.825394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.825394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.825903 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.827513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:48.925941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1115/2244] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:11:48 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:48.930096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.941688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007611b-6dc6-4d28-84c1-917dc83ff305 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.947429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.948163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.948450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.948727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.949457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.951197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:48.962234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1130/2245] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:48.966923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:48.979619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5737-722f-473e-a353-d4b969717969 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:48.984714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:48.985636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:48.985926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:48.986204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:48.986934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:48.988639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb622de0-6fba-467a-bd2f-64d56b809271 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:49.001201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1116/2246] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:11:49.005197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:49.016872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19272a0-08bb-4a2c-9255-b52b5046fff9 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:49.021942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:49.022854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:49.023147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:49.023569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] PATH_INFO: `/v3/projects/ef58e682b96f4a2cb0b35ad6eee991e5/users/d6dad40e92684d1f95fc9b3b0a0337ed/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:49.039262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef58e682b96f4a2cb0b35ad6eee991e5, user_id=d6dad40e92684d1f95fc9b3b0a0337ed, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:49.042086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:49.102228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1131/2247] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:49 2022] PUT /identity/v3/projects/ef58e682b96f4a2cb0b35ad6eee991e5/users/d6dad40e92684d1f95fc9b3b0a0337ed/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:49.107628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d86b1-d622-4045-ae00-b86a0bc23aa0 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:49.107918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d86b1-d622-4045-ae00-b86a0bc23aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:49.108195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d86b1-d622-4045-ae00-b86a0bc23aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:49.127678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f92d86b1-d622-4045-ae00-b86a0bc23aa0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:49.128906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f92d86b1-d622-4045-ae00-b86a0bc23aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:49.206754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1117/2248] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:49.217138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:49.221203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:49.292581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf622251-bc6e-4e54-b6d3-15abf5f7995b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:49.297513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:49.298176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:49.298464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:49.298747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:49.312542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:49.314549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:49.324941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1132/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:11:56.293709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:56.294326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:56.294326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:56.341765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] MFA Rules not processed for user `d6dad40e92684d1f95fc9b3b0a0337ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:11:56.343174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:11:56.397357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:56.428465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1118/2250] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:11:56.438378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:56.451316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dab96a-a3dd-4bc5-be3b-45edb64a5722 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:56.456500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:56.457533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:56.457846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:56.458136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:56.458840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:56.460902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:56.569855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1133/2251] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:11:56 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:11:56.574042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:56.588524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8fce5-2c3e-4f47-85cf-4647a45a1fdc None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:56.652289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:56.653008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:56.653585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:56.654041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:56.654722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:56.657064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:56.756700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1119/2252] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:11:56 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:11:56.761103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:56.778658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1652d0-bb9a-4e4a-872c-593085c14c87 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:56.789406 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:56.794197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:56.794197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:56.794197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:56.794197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:56.795071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:56.816269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1134/2253] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:56.820686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:56.831909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dfd0f-0df4-4a03-82be-2723960fedee admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:56.837159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:56.838442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:56.838930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:56.839213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] PATH_INFO: `/v3/projects/f39b93456085458c8771d457d2130cf9/users/3b3b9be963a24419a7272382a76918d1/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:56.862604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39b93456085458c8771d457d2130cf9, user_id=3b3b9be963a24419a7272382a76918d1, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:56.865459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:56.956271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1120/2254] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:56 2022] PUT /identity/v3/projects/f39b93456085458c8771d457d2130cf9/users/3b3b9be963a24419a7272382a76918d1/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:11:56.960347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:56.978190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a91330-178e-492e-9e7a-d7cfe17ddb4c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:57.035845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:57.048410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:57.053913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:57.053913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:57.053913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:57.053913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:57.053913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20bfee-05ce-41d1-8336-67e3d7bc4ac1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:57.064438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1135/2255] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:11:57.068356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:11:57.079659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d8e3-1685-4718-bc78-36410da59494 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:11:57.089763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:11:57.090753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:11:57.091006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:11:57.091513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] PATH_INFO: `/v3/projects/f39b93456085458c8771d457d2130cf9/users/3b3b9be963a24419a7272382a76918d1/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:11:57.094125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39b93456085458c8771d457d2130cf9, user_id=3b3b9be963a24419a7272382a76918d1, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:11:57.097610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:11:57.112990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1121/2256] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:11:57 2022] PUT /identity/v3/projects/f39b93456085458c8771d457d2130cf9/users/3b3b9be963a24419a7272382a76918d1/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:12:03.399574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4f83-8403-4eb1-887d-d923d105f1d8 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:03.400765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4f83-8403-4eb1-887d-d923d105f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:03.401945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e4f83-8403-4eb1-887d-d923d105f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:03.439510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-004e4f83-8403-4eb1-887d-d923d105f1d8 None None] MFA Rules not processed for user `3b3b9be963a24419a7272382a76918d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:03.441773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-004e4f83-8403-4eb1-887d-d923d105f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:03.522514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1136/2257] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:12:03.536281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:12:03.537981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:03.609083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d004-8ffb-4975-8484-ef02993465ea admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:12:03.612850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:12:03.613503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:03.613788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:03.614068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:03.665779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:03.680908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:12:03.683298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:12:03.695163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1122/2258] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:12:03.948813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc128-416d-4f28-bfa6-a96fc0fe3675 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:03.949106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc128-416d-4f28-bfa6-a96fc0fe3675 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:03.949386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dc128-416d-4f28-bfa6-a96fc0fe3675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:03.970836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-445dc128-416d-4f28-bfa6-a96fc0fe3675 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:03.972969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-445dc128-416d-4f28-bfa6-a96fc0fe3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:04.033872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1137/2259] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:04.046832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:12:04.048251 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:04.119496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee14270-b483-4e84-99a6-8216145ce25a service glance] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:12:04.124662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:12:04.125361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:04.125643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:04.125918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:04.134530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:12:04.136384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553964ba-e57d-4b8a-b503-19377c3de7a8 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:12:04.145210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1123/2260] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:12:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:12:14.026088 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=65 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:14.141683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=39 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:15.717553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59639-f306-46c6-98df-71831381a68e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:15.717553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59639-f306-46c6-98df-71831381a68e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:15.717553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59639-f306-46c6-98df-71831381a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:15.736247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-25e59639-f306-46c6-98df-71831381a68e None None] MFA Rules not processed for user `d6dad40e92684d1f95fc9b3b0a0337ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:15.737466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-25e59639-f306-46c6-98df-71831381a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:15.744331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1138/2261] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:17.290426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:17.290952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:17.291105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:17.309028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] MFA Rules not processed for user `593bba746dfc40dfbe768b4b9f0c78e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:17.310239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:17.365809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1124/2262] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:18.715655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b033-48b0-4692-bde8-ea057aeb20f3 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:18.715655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b033-48b0-4692-bde8-ea057aeb20f3 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:18.715655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b033-48b0-4692-bde8-ea057aeb20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:18.743294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ea62b033-48b0-4692-bde8-ea057aeb20f3 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:18.744577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ea62b033-48b0-4692-bde8-ea057aeb20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:18.768870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:12:18.771262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1139/2263] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:18.790528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64408d1a-3eec-48d5-85e9-bad4e1835a1f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:12:18.812196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:12:18.812870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:18.813157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:18.813437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:18.824684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:12:18.827275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:12:18.842190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1125/2264] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 06 13:12:20.845080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8969f0-5ddd-47af-92b5-23fe362c143c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:20.846133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8969f0-5ddd-47af-92b5-23fe362c143c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:20.846618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8969f0-5ddd-47af-92b5-23fe362c143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:20.867908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-de8969f0-5ddd-47af-92b5-23fe362c143c None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:20.869629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-de8969f0-5ddd-47af-92b5-23fe362c143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:20.880043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1140/2265] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:12:20.895812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:12:20.909182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faeb77-f8f5-4a7c-afd5-e34d912b3ea4 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:12:20.914062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:12:20.914658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:20.915143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:20.915624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:20.930777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:12:20.936967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408ae3a-39d8-4bc3-8715-53bd44318150 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:12:20.949896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1126/2266] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:12:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:12:30.863813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=9 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:30.939161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=37 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:44.125590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:44.126531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:44.126818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:44.145966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] MFA Rules not processed for user `9c620175b84d4cee9aef398864c03c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:44.147183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:44.214277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1141/2267] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:46.803785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd16d-acdd-44ed-8e62-74209c17cb10 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:12:46.804306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd16d-acdd-44ed-8e62-74209c17cb10 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:12:46.804405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd16d-acdd-44ed-8e62-74209c17cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:12:46.821481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-35fbd16d-acdd-44ed-8e62-74209c17cb10 None None] MFA Rules not processed for user `e8410e3632ec4908824d336fff667da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:12:46.822681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-35fbd16d-acdd-44ed-8e62-74209c17cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:12:46.877036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1127/2268] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:12:54.207759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=25 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:56.870086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=25 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:05.658781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:05.662932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:05.741588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1b4c9-b600-4e47-a5df-07bcbf55aea8 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:05.745701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:05.746422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:05.746714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:05.746994 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:05.760553 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:05.762089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:05.773513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1142/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:15.769399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=26 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:17.046481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:17.050782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:17.050782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:17.064870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] MFA Rules not processed for user `15aec8f2f71e4084a21cc0cfc3a52bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:17.066723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:17.122087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1128/2270] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:21.126514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:21.136521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4abd-9db2-4953-9708-182f04be2c39 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:21.140461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:21.141174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:21.141529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:21.141878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:21.144502 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:21.216329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:21.217757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:21.229321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1143/2271] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:23.585377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:23.594788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ada67-0d88-4fe6-91c7-6088a04df4ab None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:23.598985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:23.599646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:23.599936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:23.600214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:23.601989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:23.615579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:23.616998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:23.627891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1129/2272] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:31.224187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=34 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:33.623119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=31 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:40.081752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:40.084077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:40.150568 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85967d1-611f-41fd-9c92-4192b3c2fc9b service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:40.155081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:40.155984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:40.156284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:40.156561 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] PATH_INFO: `/v3/users/593bba746dfc40dfbe768b4b9f0c78e3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:40.157757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593bba746dfc40dfbe768b4b9f0c78e3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:40.159715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:40.298980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593bba746dfc40dfbe768b4b9f0c78e3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.299671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593bba746dfc40dfbe768b4b9f0c78e3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.359757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593bba746dfc40dfbe768b4b9f0c78e3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.372475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593bba746dfc40dfbe768b4b9f0c78e3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.379308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-31ad7674-4042-4717-85ca-0d1fa204b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593bba746dfc40dfbe768b4b9f0c78e3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.386321 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1144/2273] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:13:40 2022] DELETE /identity/v3/users/593bba746dfc40dfbe768b4b9f0c78e3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:13:40.641232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:40.652519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7615fd-13be-4de4-95e4-1ae295d1b3c5 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:40.713640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:40.714582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:40.714941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:40.715293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] PATH_INFO: `/v3/projects/c6c440914e0f40e49b9fc8ab9f4b6f48` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:40.716737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c440914e0f40e49b9fc8ab9f4b6f48)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:40.718733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:40.834183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'request_id': 'req-f8952238-202d-422b-9571-b3a2572d77d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.838489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'request_id': 'req-f8952238-202d-422b-9571-b3a2572d77d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.932165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'request_id': 'req-f8952238-202d-422b-9571-b3a2572d77d5'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.947415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] The token cache is being invalidate because project c6c440914e0f40e49b9fc8ab9f4b6f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:13:40.948246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.948795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f8952238-202d-422b-9571-b3a2572d77d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:13:40.950638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1130/2274] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:13:40 2022] DELETE /identity/v3/projects/c6c440914e0f40e49b9fc8ab9f4b6f48 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:13:40.956650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:40.956810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:40.957145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:40.987787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:40.989023 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:41.053895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1145/2275] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:41.062211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.062507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.062878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.082053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:41.083947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:41.092281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1131/2276] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:13:41.096458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.107448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17fac7-4be1-4263-b42a-27eeed1496b7 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.112403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.113061 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.113344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.113615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.114869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:13:41.115191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.117041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.128795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1146/2277] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:13:41.134506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.143725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b18f8c-e17b-4ff4-b0a0-11bdb081fcb4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.149267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.153594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.153594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.153594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.153594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.153594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.279898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1132/2278] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:13:41 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:13:41.281020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.291731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52753c-5856-43dd-88f2-6aedc91f0e3f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.295513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:41.353380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.354063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.354353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.354636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.355438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.357437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.435493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1147/2279] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:13:41 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:13:41.439269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.463437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749782da-88bb-4090-b33f-1f07ab3c97f2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.470197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.483359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.483359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.483359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.483359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.483359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.485327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1133/2280] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:13:41.491984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.508079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb8490-2697-4904-94f8-e50cac1d56e2 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.513921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.514677 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.514963 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.515244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.516064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.517678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a077b-1a33-46c0-8c12-c1b6bc9c1ffd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.534200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1148/2281] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:13:41.535443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.552517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7df71-110c-4911-9597-1661e8deef33 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.559279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.560096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.560339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.560783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] PATH_INFO: `/v3/projects/332996ee21f54ef3b78907332f5decce/users/bd78c278513540ecadfc1a0f90b9ab16/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.578842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=332996ee21f54ef3b78907332f5decce, user_id=bd78c278513540ecadfc1a0f90b9ab16, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.582097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.700919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1134/2282] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:13:41 2022] PUT /identity/v3/projects/332996ee21f54ef3b78907332f5decce/users/bd78c278513540ecadfc1a0f90b9ab16/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:13:41.706379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.707087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.707685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.729128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:41.730770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:41.799422 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1149/2283] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:41.809769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:41.811980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:41.853602 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:41.881047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b6371-4eed-485d-8a15-402074a67d9d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:41.884829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:41.885552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:41.885915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:41.886268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:41.896587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:41.898550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:41.909286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1135/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:43.705903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:43.707395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:43.796919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ccdfa-20db-4f0f-997e-9871ec390181 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:43.803894 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:43.805211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:43.806230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:43.807039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:43.809649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:43.866252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:43.888727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:43.890225 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e039-4507-445c-95e8-a235e1aa380c service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:43.900865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1150/2285] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:44.177841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:44.177841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:44.274485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2592-acb1-4506-ba79-9d8a7e8fc45a service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:44.282026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:44.282935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:44.284799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:44.285157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:44.288158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:44.376826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:44.379220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14fa5-7bfc-473c-86db-9ead4b358a32 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:44.396705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1136/2286] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:47.837916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:47.840738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:47.840738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:47.865384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] MFA Rules not processed for user `288ab671062d409f98b91aeacde8b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:47.867861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:47.883215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1151/2287] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:48.338661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.339163 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.339278 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.373861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] MFA Rules not processed for user `bd78c278513540ecadfc1a0f90b9ab16`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:48.375346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:48.478369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:48.488174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1137/2288] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:48.492842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:48.506011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27203ab4-6061-4891-899d-8f9cf5a66521 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:48.516060 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:48.516911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.517093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.517400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.519124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:48.520076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:48.582940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:48.585895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:48.598604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713d138-8d0b-4b87-beb9-31576ad84870 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:48.603444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:48.604464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.604844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.605372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.608189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:48.619452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1152/2289] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:13:48 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:13:48.624166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:48.626532 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:48.628446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:48.642060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1138/2290] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:13:48.699310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad6f0-0460-4a40-9acb-7b910a01fced admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:48.705083 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:48.705767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.706058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.706346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.707041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:48.709562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:48.805539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1153/2291] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:13:48 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:13:48.806797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:48.820549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d7c7c-1189-4e12-b6b6-1d4899eee28b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:48.825696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:48.826479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.830307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.830307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.830307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:48.830307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:48.845268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1139/2292] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:13:48.848077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:48.859266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1e8b-37f6-4a0e-b3c1-f598af7b56d4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:48.864273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:48.865746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:48.866034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:48.866468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] PATH_INFO: `/v3/projects/ca11d0c8e89d4a09815d0682892d4865/users/a8f6ee8e992c4fa6baaeb63144e791e0/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:48.892940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11d0c8e89d4a09815d0682892d4865, user_id=a8f6ee8e992c4fa6baaeb63144e791e0, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:48.892940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:48.995861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1154/2293] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:13:48 2022] PUT /identity/v3/projects/ca11d0c8e89d4a09815d0682892d4865/users/a8f6ee8e992c4fa6baaeb63144e791e0/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:13:49.000051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:49.010819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83e3-7f0d-415f-b7c3-77549787179d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:49.071036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:49.071853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:49.072130 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:49.072407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:49.073200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:49.075675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:49.086144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1140/2294] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:13:49.091140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:49.106700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcf29b-9715-4a5e-a5ca-25b88e2003d6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:49.111964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:49.112851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:49.113220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:49.113571 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] PATH_INFO: `/v3/projects/ca11d0c8e89d4a09815d0682892d4865/users/a8f6ee8e992c4fa6baaeb63144e791e0/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:49.115746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11d0c8e89d4a09815d0682892d4865, user_id=a8f6ee8e992c4fa6baaeb63144e791e0, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:49.118507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:49.119298 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:49.120334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:49.131404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1155/2295] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:13:49 2022] PUT /identity/v3/projects/ca11d0c8e89d4a09815d0682892d4865/users/a8f6ee8e992c4fa6baaeb63144e791e0/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:13:49.207044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2e64-38ef-4659-ab4b-0e35fd890dc2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:49.276579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:49.277158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:49.277446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:49.277724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:49.280271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:49.297433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:49.298929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:49.308387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:49.313781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1141/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:13:52.248043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:52.249820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:52.372002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:52.378588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0e3f-8d49-40e8-8274-96d75e247c95 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:52.385340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:52.388008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:52.388008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:52.388008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:52.389283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:52.494722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:52.502686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:52.545025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1156/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:53.623546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:53.708360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da96f7-3bd9-4449-affc-9623d0d6f540 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:53.712939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:53.713609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:53.713898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:53.714177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:53.716917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:53.729186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:53.730613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec619f3-ce73-4f68-ba18-0e00cdaede8e service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:53.743027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1142/2298] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:55.577123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:55.600858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2415-0859-402b-8d79-62f00bac500f service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:55.611207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:55.612213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:55.612766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:55.613244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:55.617622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:55.644519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:55.648348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:55.665884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1157/2299] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:13:56.942786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:56.944806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:56.945209 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:56.978167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] MFA Rules not processed for user `a8f6ee8e992c4fa6baaeb63144e791e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:13:56.979827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:13:57.063919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1143/2300] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:13:57.079361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:13:57.091735 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76bb59-8cc7-4771-bd6b-81f2e7aadae7 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:13:57.097436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:13:57.098082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:13:57.098364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:13:57.098640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:13:57.158308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:13:57.159948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:13:57.170522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1158/2301] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:13:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:02.324279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:02.340714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3a7b-c8d4-4197-aed8-638fc6686e28 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:02.346806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:02.347594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:02.347964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:02.348322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:02.350572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:02.363382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:02.365601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:02.376703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1144/2302] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:06.884395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:06.896054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6807be-3eaf-4c1e-9bbe-e7d074f74623 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:06.902676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:06.905505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:06.905876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:06.906152 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:06.908131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:06.923074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:06.927730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:06.937414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1159/2303] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:12.372226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=66 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:12.872192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:12.886516 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d448a9-194d-400a-be7f-9b652445bde7 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:12.890215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:12.890876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:12.891190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:12.891475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:12.893585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:12.971771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:12.973334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfc3cb-f686-45e9-befe-2c7e26da6fa0 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:12.983812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1145/2304] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:16.933715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=67 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:17.312826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:17.314436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:17.328858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316db6-6dfa-423f-9ecf-edb63a6944ee service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:17.333660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:17.334679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:17.334965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:17.335241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] PATH_INFO: `/v3/users/e8410e3632ec4908824d336fff667da5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:17.336469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8410e3632ec4908824d336fff667da5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:17.338916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:17.560160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:17.561067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:17.561227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8410e3632ec4908824d336fff667da5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:17.561357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:17.562389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8410e3632ec4908824d336fff667da5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:17.580027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] MFA Rules not processed for user `bd78c278513540ecadfc1a0f90b9ab16`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:17.581322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:17.591563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1146/2305] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:17.660080 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8410e3632ec4908824d336fff667da5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:17.675708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8410e3632ec4908824d336fff667da5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:17.683337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0cf28dfe-0a97-40a2-912a-8009c68a3651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8410e3632ec4908824d336fff667da5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:17.689687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1160/2306] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:17 2022] DELETE /identity/v3/users/e8410e3632ec4908824d336fff667da5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:17.941790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:17.943415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:17.961750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209ce71-0f81-4944-b1fd-711cfc1d8262 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.027027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.027999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.028286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.028564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] PATH_INFO: `/v3/projects/d2263cfc378b4967ab4d2817991874f5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.029819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2263cfc378b4967ab4d2817991874f5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.031799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.141105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2263cfc378b4967ab4d2817991874f5', 'request_id': 'req-67596793-8331-48e0-97ac-38c2a855722b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:18.147972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2263cfc378b4967ab4d2817991874f5', 'request_id': 'req-67596793-8331-48e0-97ac-38c2a855722b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:18.240842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2263cfc378b4967ab4d2817991874f5', 'request_id': 'req-67596793-8331-48e0-97ac-38c2a855722b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:18.252608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] The token cache is being invalidate because project d2263cfc378b4967ab4d2817991874f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:18.256078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:18.256078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-67596793-8331-48e0-97ac-38c2a855722b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:18.256078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1147/2307] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:17 2022] DELETE /identity/v3/projects/d2263cfc378b4967ab4d2817991874f5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:18.260918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f0f6-f384-4809-8064-fce047c789d9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.261437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f0f6-f384-4809-8064-fce047c789d9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.261546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25f0f6-f384-4809-8064-fce047c789d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.280333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2e25f0f6-f384-4809-8064-fce047c789d9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:18.281544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2e25f0f6-f384-4809-8064-fce047c789d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:18.303568 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.304081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.304369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.323661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] MFA Rules not processed for user `9c620175b84d4cee9aef398864c03c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:18.325002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:18.339648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:18.362256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1161/2308] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:18.370020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.370310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.370952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.393938 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1148/2309] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:18.394511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:18.395812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:18.406316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1162/2310] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:18.411413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.424013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc33a43-d5de-4902-ad81-f7b81da3d2d6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.429790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.430537 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.430900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.431254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.432228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:14:18.432543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.434384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.447242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1149/2311] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:14:18.452146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.468507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6fb1a-7461-4a40-b3bf-a2bf2ffc7de8 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.476057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.477310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.477725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.478111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.479652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.481605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.590560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1163/2312] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:18 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:18.592118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.604304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56831-da89-4739-a473-c57b5aa4cf2f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.670029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.671255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.671255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.671255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.671997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.673913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.742162 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.743969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:18.790433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1150/2313] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:18 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:18.792652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:18.794793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.803899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5aab-57b4-45b4-8a26-39244e97bcd7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.805070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6179dd-a246-480b-9f49-39ee6bc11cfc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.808950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.809609 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.809898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.810201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.811318 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.812004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.812134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:18.812306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.812574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.813305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.814893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.823108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.830079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.830215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1151/2314] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:14:18.830924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.833318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1164/2315] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:14:18.840902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00b1-7c61-493b-9447-f24992837912 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.845817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.846480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.846764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.847039 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.847800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.849425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cd9d2-ae88-42b7-a68f-e7ef3928cf6c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.860652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1152/2316] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:14:18.864869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:18.877365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2f269-ccb0-43c5-a79e-4fae8505144e service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:18.882253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:18.883194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:18.883486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:18.883795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] PATH_INFO: `/v3/projects/013fab1304b545b69b798225bc6fb89b/users/08906cf78f47409c927d26da11d03c6f/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:18.899517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013fab1304b545b69b798225bc6fb89b, user_id=08906cf78f47409c927d26da11d03c6f, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:18.902256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:18.997354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1165/2317] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:18 2022] PUT /identity/v3/projects/013fab1304b545b69b798225bc6fb89b/users/08906cf78f47409c927d26da11d03c6f/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:19.008260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:19.008597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:19.008875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:19.042113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] MFA Rules not processed for user `08906cf78f47409c927d26da11d03c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:19.042113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:19.086091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:19.087837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:19.121248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1153/2318] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:19.205608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34bd1-0994-4c2c-8834-f36ebe3498e9 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:19.214313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:19.218756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:19.218756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:19.218756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:19.218756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:19.287676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:19.289162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:19.295787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:19.297618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:19.306107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d2ef6-bff8-4f82-b851-63787c016e67 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:19.312060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:19.312354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1166/2319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:19.321660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:19.321985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:19.322228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:19.338702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:19.342961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:19.345534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0130-6e6c-4bca-820c-53363c1d405d service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:19.357036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1154/2320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:19.604435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:19.683046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f5cd-264e-4270-8556-cef1ece50a94 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:19.687913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:19.688794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:19.689086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:19.689370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] PATH_INFO: `/v3/users/08906cf78f47409c927d26da11d03c6f` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:19.690607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08906cf78f47409c927d26da11d03c6f)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:19.692679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:19.694222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:19.879395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08906cf78f47409c927d26da11d03c6f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:19.880672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08906cf78f47409c927d26da11d03c6f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:19.962047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08906cf78f47409c927d26da11d03c6f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:19.975205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08906cf78f47409c927d26da11d03c6f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:19.982989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08906cf78f47409c927d26da11d03c6f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:19.989312 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1167/2321] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:19 2022] DELETE /identity/v3/users/08906cf78f47409c927d26da11d03c6f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:19.993598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1291-5d12-4447-819b-56305419a323 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:19.994084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1291-5d12-4447-819b-56305419a323 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:19.994345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1291-5d12-4447-819b-56305419a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:20.012517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-169f1291-5d12-4447-819b-56305419a323 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:20.013741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-169f1291-5d12-4447-819b-56305419a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:20.080655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1155/2322] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:20.091221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:20.092756 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:20.157827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2099-b6bc-46a5-93ed-0730cbbad353 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:20.162003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:20.162751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:20.163071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:20.163353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:20.173867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:20.175361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047dfa-05fa-4839-bc9e-563b3fefd150 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:20.186700 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1168/2323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:20.656116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1291-5d12-4447-819b-56305419a323 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:20.656517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-169f1291-5d12-4447-819b-56305419a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:20.689198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1291-5d12-4447-819b-56305419a323 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:20.693867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:20.694727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:20.695009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:20.695283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] PATH_INFO: `/v3/projects/013fab1304b545b69b798225bc6fb89b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:20.696620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=013fab1304b545b69b798225bc6fb89b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:20.699050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:20.810682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013fab1304b545b69b798225bc6fb89b', 'request_id': 'req-845782ab-1f27-4b48-98ce-d0e6becbbb2b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:20.817358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013fab1304b545b69b798225bc6fb89b', 'request_id': 'req-845782ab-1f27-4b48-98ce-d0e6becbbb2b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:20.956124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013fab1304b545b69b798225bc6fb89b', 'request_id': 'req-845782ab-1f27-4b48-98ce-d0e6becbbb2b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:20.969844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] The token cache is being invalidate because project 013fab1304b545b69b798225bc6fb89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:20.970138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:20.970800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-845782ab-1f27-4b48-98ce-d0e6becbbb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:20.972720 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1156/2324] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:20 2022] DELETE /identity/v3/projects/013fab1304b545b69b798225bc6fb89b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:20.977603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:20.978130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:20.978325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:20.997838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:20.999045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:21.061339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1169/2325] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:21.069215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.069676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.069794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.088330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:21.092445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:21.097480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1157/2326] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:21.101649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.112170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566fe42-ae80-46cb-a3a1-75f1c43b0871 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.116792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.117440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.117722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.117998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.118713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:14:21.119018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.121137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.134713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1170/2327] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:14:21.139662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.149464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723b49e-6534-4ef2-a271-4566768c7c5f None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.154229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.154887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.155173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.155452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.156214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.158107 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.272038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1158/2328] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:21 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:21.276132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.286411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f77dce-b6dd-4034-9782-95ed01ddf32f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.291625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:21.346714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.347311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.347635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.347918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.348605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.350545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.457308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1171/2329] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:21 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:21.458773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.469786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a94af-6719-4e33-9925-212664b059f3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.475191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.475952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.476246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.476523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.477281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.478969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.490626 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1159/2330] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:21.494530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.505044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db9e1-95a8-4954-bb5c-193c50e4e08e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.509949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.511090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.511369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.516844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.516844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.516844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4531eb2-b157-4aa4-908c-a70d252c2354 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.523793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1172/2331] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:21.528555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.538784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b377-53d2-4d1a-8bf5-3de3591b3600 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.545450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.546346 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.546635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.547143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] PATH_INFO: `/v3/projects/fd89c03143794a2bbef12dcf5bdbacdd/users/54014c6e870540d99ab7eb8b58b1164b/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.563671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd89c03143794a2bbef12dcf5bdbacdd, user_id=54014c6e870540d99ab7eb8b58b1164b, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.567184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:21.643763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1160/2332] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:21 2022] PUT /identity/v3/projects/fd89c03143794a2bbef12dcf5bdbacdd/users/54014c6e870540d99ab7eb8b58b1164b/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:21.654286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.654587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.654874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.715136 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] MFA Rules not processed for user `54014c6e870540d99ab7eb8b58b1164b`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:21.716492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:21.794671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1173/2333] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:21.803143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:21.830508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:21.895901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4537c-6ed2-4b86-966d-0f62227ec1b8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:21.901916 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:21.902754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:21.902902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:21.909213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:21.909213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:21.909213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.040877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1161/2334] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:21 2022] POST /identity/v3/projects => generated 363 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:22.052960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.058247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076b389-12df-49c6-9920-2fef0e872d0f None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.122230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.123185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.123837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.124123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.124826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.127230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.219181 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1174/2335] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:22 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:22.221150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.235132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02002fa5-3fb1-41c2-9721-7c68fcdded71 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.242399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.242990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.243361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.243684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.244833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.251130 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.264433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1162/2336] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:22.268795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.279959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad813-3b2d-428f-9032-24c9989c4ffb admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.285495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.286417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.286706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.286984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] PATH_INFO: `/v3/projects/b1a9a9332a3e4ad4adddca404b659516/users/abfc769eede14aeda7edb8f0f583e50d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.290661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:22.304618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a9a9332a3e4ad4adddca404b659516, user_id=abfc769eede14aeda7edb8f0f583e50d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.307275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.407424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1175/2337] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:22 2022] PUT /identity/v3/projects/b1a9a9332a3e4ad4adddca404b659516/users/abfc769eede14aeda7edb8f0f583e50d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:22.411228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.425747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69d1f5-c39f-41f2-a595-1a32e1e7fcfe admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.494080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.494935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.495674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.496060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.497566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.499324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685bc70-8634-44a9-a41d-76105e10a063 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.511188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1163/2338] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:22.515933 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.539573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696634-c8f7-4460-a04d-e809d2adfd49 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.553870 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.555288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.555288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.555710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] PATH_INFO: `/v3/projects/b1a9a9332a3e4ad4adddca404b659516/users/abfc769eede14aeda7edb8f0f583e50d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.558722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a9a9332a3e4ad4adddca404b659516, user_id=abfc769eede14aeda7edb8f0f583e50d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.562175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.574405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1176/2339] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:22 2022] PUT /identity/v3/projects/b1a9a9332a3e4ad4adddca404b659516/users/abfc769eede14aeda7edb8f0f583e50d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:22.585579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.586520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.586520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.626130 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] MFA Rules not processed for user `abfc769eede14aeda7edb8f0f583e50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:22.628422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:22.744212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1164/2340] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:22.756386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:22.758264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:22.848698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43dcc-36cc-464c-afd8-e34e14fb4c1a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:22.853507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:22.857094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:22.857419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:22.857902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:22.869285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:22.870780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:22.882761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1177/2341] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:23.156356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:23.157833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:23.178661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9648f-9d7e-4517-9fbe-d90a04397aa9 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:23.181280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:23.181950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:23.182240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:23.182522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:23.193974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:23.254315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:23.258661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ca4a-e918-4f75-8a13-464ea7fca024 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:23.267140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1165/2342] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:26.873618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:26.959876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf7a4c-45c0-441c-bf57-a50aaf941f1d service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:26.964749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:26.965848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:26.966380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:26.966665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] PATH_INFO: `/v3/users/54014c6e870540d99ab7eb8b58b1164b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:26.968009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=54014c6e870540d99ab7eb8b58b1164b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:26.969974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:27.160067 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54014c6e870540d99ab7eb8b58b1164b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:27.160729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54014c6e870540d99ab7eb8b58b1164b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:27.253226 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54014c6e870540d99ab7eb8b58b1164b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:27.266219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54014c6e870540d99ab7eb8b58b1164b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:27.268240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:27.290775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54014c6e870540d99ab7eb8b58b1164b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:27.290775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1178/2343] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:26 2022] DELETE /identity/v3/users/54014c6e870540d99ab7eb8b58b1164b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:27.291014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:27.291014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:27.291014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:27.303912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:27.305126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:27.364187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1166/2344] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:27.373754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:27.375153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:27.431546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeabb4-8ad7-46c3-ba2b-f9ba5de6afcc admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:27.435182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:27.435851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:27.436137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:27.436428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:27.445100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:27.446507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:27.456851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1179/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:27.947687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:27.950632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:27.963986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f77b0-6dde-462c-b8d9-ded3966041e3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:27.969064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:27.969965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:27.970252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:27.970528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] PATH_INFO: `/v3/projects/fd89c03143794a2bbef12dcf5bdbacdd` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:27.971823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd89c03143794a2bbef12dcf5bdbacdd)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:27.973934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:28.090261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd89c03143794a2bbef12dcf5bdbacdd', 'request_id': 'req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.096879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd89c03143794a2bbef12dcf5bdbacdd', 'request_id': 'req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.162085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd89c03143794a2bbef12dcf5bdbacdd', 'request_id': 'req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.174590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] The token cache is being invalidate because project fd89c03143794a2bbef12dcf5bdbacdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:28.174887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.175609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.177104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1167/2346] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:27 2022] DELETE /identity/v3/projects/fd89c03143794a2bbef12dcf5bdbacdd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:28.181428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:28.191771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c12fb-516e-4fca-a76c-cf29f034a1a8 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:28.249057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:28.249935 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:28.250219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:28.250492 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] PATH_INFO: `/v3/users/abfc769eede14aeda7edb8f0f583e50d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:28.251725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfc769eede14aeda7edb8f0f583e50d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:28.253653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:28.410896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfc769eede14aeda7edb8f0f583e50d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.411467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfc769eede14aeda7edb8f0f583e50d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.464907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfc769eede14aeda7edb8f0f583e50d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.478299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfc769eede14aeda7edb8f0f583e50d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.486366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b98dcfc0-1f3a-4b53-b43d-8d1bc783bba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfc769eede14aeda7edb8f0f583e50d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:28.492764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1180/2347] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:28 2022] DELETE /identity/v3/users/abfc769eede14aeda7edb8f0f583e50d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:29.026874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.028486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:29.043484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7a3a-98cd-4d2f-9b06-432626b4572a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.094215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:29.117767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.118650 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.118932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.119207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] PATH_INFO: `/v3/projects/b1a9a9332a3e4ad4adddca404b659516` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.120407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a9a9332a3e4ad4adddca404b659516)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.122328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.226952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a9a9332a3e4ad4adddca404b659516', 'request_id': 'req-9bcabb84-6dee-44ed-b0fb-5634d737734b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:29.233757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a9a9332a3e4ad4adddca404b659516', 'request_id': 'req-9bcabb84-6dee-44ed-b0fb-5634d737734b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:29.328046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a9a9332a3e4ad4adddca404b659516', 'request_id': 'req-9bcabb84-6dee-44ed-b0fb-5634d737734b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:29.339992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] The token cache is being invalidate because project b1a9a9332a3e4ad4adddca404b659516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:29.340370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:29.343479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9bcabb84-6dee-44ed-b0fb-5634d737734b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:29.343479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1168/2348] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:29 2022] DELETE /identity/v3/projects/b1a9a9332a3e4ad4adddca404b659516 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:29.347717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.348208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.348309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.366692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:29.367923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:29.377104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:29.426859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1181/2349] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:29.434546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.435485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.435856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.454723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:29.455887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:29.464158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1169/2350] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:29.468368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.478159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c61e8-4cde-4f7f-be0f-1f79292b0450 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.482713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.483355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.483667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.483942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.484657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:14:29.484986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.486619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.498527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1182/2351] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:14:29.502893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.512188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a14b65-7458-4a66-9150-ade52aae0206 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.517511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.518156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.518444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.518724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.519445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.521485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.616621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1170/2352] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:29 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:29.620788 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.631745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347bdb-4d14-4488-b478-e853ddc0fea7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.691762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.692443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.692730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.693006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.693704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.695637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.780678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1183/2353] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:29 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:29.787370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.796360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b9df-5856-4e93-b707-27d06e767f90 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.801365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.802151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.802511 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.802876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.803685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.805372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.816230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1171/2354] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:29.820245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.830734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052922b9-bd64-4167-b3af-71181901ec16 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.835337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.836039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.836320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.836596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.837318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.838903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b223ee0-58d7-4c72-9a11-ec29e084d656 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.850589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1184/2355] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:29.854765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:29.865601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e825-94e1-4aa4-84b7-c0571aea0385 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:29.870654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:29.871658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:29.872018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:29.872459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] PATH_INFO: `/v3/projects/af01ed47eea946d2800a2096eb07ed88/users/010ce818946147d4956897533b18c5c4/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:29.887782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af01ed47eea946d2800a2096eb07ed88, user_id=010ce818946147d4956897533b18c5c4, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:29.891668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:29.992790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1172/2356] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:29 2022] PUT /identity/v3/projects/af01ed47eea946d2800a2096eb07ed88/users/010ce818946147d4956897533b18c5c4/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:30.004437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:30.004738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:30.005019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:30.035989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] MFA Rules not processed for user `010ce818946147d4956897533b18c5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:30.037214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:30.111096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1185/2357] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:30.117609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:30.242740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:30.252312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a30c5-43f8-4ada-a0d9-4443a0db185e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:30.268250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:30.268940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:30.272179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:30.272179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:30.272179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:30.272179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:30.453827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1173/2358] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:30 2022] POST /identity/v3/projects => generated 369 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:30.457868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:30.488301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efef8a-150d-4717-b59f-6440e86fe621 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:30.489543 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:30.633776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:30.634793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:30.635293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:30.635874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:30.636781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:30.651838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:30.760495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1186/2359] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:30 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:30.765807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:30.776823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877914df-0973-42c5-b250-2113a380df2f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:30.785687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:30.785687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:30.785687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:30.785687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:30.786619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:30.788535 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:30.803571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1174/2360] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:30.806654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:30.818272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ff90-5739-41df-904f-866de1ee7069 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:30.823505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:30.824223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:30.824507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:30.824786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] PATH_INFO: `/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e/users/1eef13e7842f48b5b84f0c1086f4d2aa/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:30.842587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18a1504f82f4f40a30b8f6a1ca0390e, user_id=1eef13e7842f48b5b84f0c1086f4d2aa, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:30.845281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:30.936657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1187/2361] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:30 2022] PUT /identity/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e/users/1eef13e7842f48b5b84f0c1086f4d2aa/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:30.940644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:30.952573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9c25-1e29-4a11-bffb-90b92c10409b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:31.024421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:31.025104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:31.025393 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:31.025674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:31.026408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:31.028214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929f35-233a-4ee2-9757-5c1ab56ed829 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:31.045027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1175/2362] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:31.046856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:31.058361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875d2e1-eb55-46b7-8acc-05ad965fd98d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:31.064738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:31.065622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:31.065914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:31.066209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] PATH_INFO: `/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e/users/1eef13e7842f48b5b84f0c1086f4d2aa/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:31.068265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18a1504f82f4f40a30b8f6a1ca0390e, user_id=1eef13e7842f48b5b84f0c1086f4d2aa, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:31.070982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:31.083180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1188/2363] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:31 2022] PUT /identity/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e/users/1eef13e7842f48b5b84f0c1086f4d2aa/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:31.093368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:31.093751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:31.094104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:31.123199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] MFA Rules not processed for user `1eef13e7842f48b5b84f0c1086f4d2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:31.124457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:31.198966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1176/2364] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:31.211494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:31.213400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:31.273338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad655f-9cd3-4467-a427-096c23693971 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:31.277171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:31.277816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:31.278101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:31.278376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:31.289637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:31.291195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:31.301740 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1189/2365] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:14:31.445111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:31.446635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:31.460387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca202e8f-9b37-4187-ab95-265168f978bd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:31.463978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:31.467946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:31.467946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:31.467946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:31.532242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:31.534426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d246f-c15e-4ccf-b841-f2c9e30ffcae service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:31.544928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1177/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:31.613794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:36.594713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:36.665770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488728a9-df24-4147-98f6-8e23ebe95451 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:36.673122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:36.674198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:36.674563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:36.674947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] PATH_INFO: `/v3/users/010ce818946147d4956897533b18c5c4` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:36.676355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010ce818946147d4956897533b18c5c4)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:36.678559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:36.683807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:36.873413 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010ce818946147d4956897533b18c5c4'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:36.874068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010ce818946147d4956897533b18c5c4'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:36.968254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010ce818946147d4956897533b18c5c4'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:36.982923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010ce818946147d4956897533b18c5c4'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:36.992284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010ce818946147d4956897533b18c5c4'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:36.998673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1190/2367] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:36 2022] DELETE /identity/v3/users/010ce818946147d4956897533b18c5c4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:37.003472 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:37.004026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:37.004269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:37.022562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:37.024214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:37.087486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1178/2368] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:37.097769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:37.099199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:37.160958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69bb2-ad86-4693-92db-709f78d284a1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:37.164582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:37.165234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:37.165520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:37.165799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:37.175959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:37.177391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:37.191134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1191/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:37.564290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:37.565761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:37.578753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578f20-00fb-4085-a731-85619d6c72b6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:37.583448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:37.587694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:37.587694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:37.587694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] PATH_INFO: `/v3/projects/af01ed47eea946d2800a2096eb07ed88` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:37.587694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af01ed47eea946d2800a2096eb07ed88)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:37.588175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:37.719137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af01ed47eea946d2800a2096eb07ed88', 'request_id': 'req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:37.725809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af01ed47eea946d2800a2096eb07ed88', 'request_id': 'req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:37.796814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af01ed47eea946d2800a2096eb07ed88', 'request_id': 'req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:37.808394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] The token cache is being invalidate because project af01ed47eea946d2800a2096eb07ed88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:37.808616 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:37.809262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:37.810837 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1179/2370] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:37 2022] DELETE /identity/v3/projects/af01ed47eea946d2800a2096eb07ed88 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:37.814927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:37.825304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b0cf-6b0d-4c71-9135-e42427594bd9 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:37.884049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:37.884924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:37.885209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:37.885487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] PATH_INFO: `/v3/users/1eef13e7842f48b5b84f0c1086f4d2aa` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:37.886743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eef13e7842f48b5b84f0c1086f4d2aa)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:37.889714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:38.044171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:38.183297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eef13e7842f48b5b84f0c1086f4d2aa'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:38.183979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eef13e7842f48b5b84f0c1086f4d2aa'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:38.299451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eef13e7842f48b5b84f0c1086f4d2aa'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:38.313058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eef13e7842f48b5b84f0c1086f4d2aa'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:38.320299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-47cbafd2-e9a2-4457-8fc5-443d35bd9646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eef13e7842f48b5b84f0c1086f4d2aa'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:38.328547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1192/2371] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:37 2022] DELETE /identity/v3/users/1eef13e7842f48b5b84f0c1086f4d2aa => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:38.900240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:38.902552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:38.917032 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931c01f-c2fc-45eb-bbe4-fc744a5cac31 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.012396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.013308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.013588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.013863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] PATH_INFO: `/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.015066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18a1504f82f4f40a30b8f6a1ca0390e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.017088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.035082 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:39.187140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18a1504f82f4f40a30b8f6a1ca0390e', 'request_id': 'req-8d92488c-d7c7-4182-b4e6-f14a173e7517'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:39.193367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18a1504f82f4f40a30b8f6a1ca0390e', 'request_id': 'req-8d92488c-d7c7-4182-b4e6-f14a173e7517'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:39.294229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18a1504f82f4f40a30b8f6a1ca0390e', 'request_id': 'req-8d92488c-d7c7-4182-b4e6-f14a173e7517'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:39.307382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] The token cache is being invalidate because project a18a1504f82f4f40a30b8f6a1ca0390e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:39.307890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:39.308405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8d92488c-d7c7-4182-b4e6-f14a173e7517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:39.310096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1180/2372] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:38 2022] DELETE /identity/v3/projects/a18a1504f82f4f40a30b8f6a1ca0390e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:39.315425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.315913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.315913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.336606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:39.337993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:39.402973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1193/2373] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:39.411909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.412299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.412596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.433884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:39.436115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:39.444683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1181/2374] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:39.449106 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.459765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60983a0-0009-40ff-b7f4-4f7ba576b4a0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.464500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.465168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.465582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.465857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.466769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:14:39.467077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.468866 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.486278 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1194/2375] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:14:39.487503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.498805 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a739e-63b1-4a08-b776-54a3349babf3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.504584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.505412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.505843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.506223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.507176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.509647 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.599236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1182/2376] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:39 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:39.602305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.614051 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8aadc-d4e6-40fe-ab7b-92de263f9529 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.684285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.685478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.685943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.686567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.687288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.689277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.770238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1195/2377] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:39 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:39.773686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.785358 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84492-178b-4503-bd43-437fe2876002 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.790145 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.790808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.791094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.791370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.792127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.794035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.805464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1183/2378] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:39.809391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.820284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a708-8198-49d8-bc5f-81ac2f226333 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.825144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.826494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.826790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.827065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.827847 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.829461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dabc3-c2e4-4374-8c1a-c7687482dd0b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.839519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1196/2379] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:39.843688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:39.853703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8a2b-efb4-41cc-b994-64545009223b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:39.858714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:39.859623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:39.859914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:39.860192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] PATH_INFO: `/v3/projects/166e784ab7744e62aa89c955024f1eb3/users/772ab51b0527436ba82c87c19d3f8b1c/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:39.875401 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e784ab7744e62aa89c955024f1eb3, user_id=772ab51b0527436ba82c87c19d3f8b1c, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:39.878088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:39.991313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1184/2380] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:39 2022] PUT /identity/v3/projects/166e784ab7744e62aa89c955024f1eb3/users/772ab51b0527436ba82c87c19d3f8b1c/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:40.003199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.003497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.003832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.024537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:40.032682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] MFA Rules not processed for user `772ab51b0527436ba82c87c19d3f8b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:40.033965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:40.104658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1197/2381] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:40.110709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.175670 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e1258-ca99-42f5-a7f8-8595a7291518 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.180378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.181034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.181325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.181608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.182313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.184300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.266934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1185/2382] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:40 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:40.270945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.282121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd797bd-f051-4042-9d00-8a7af530586a None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.338233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.338908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.339179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.339456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.340164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.342741 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.451497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1198/2383] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:40 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:40.453437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.463734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84612f-d01d-4e0d-88ef-83dc3b490766 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.468764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.469465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.469902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.470182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.470949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.472601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.483445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1186/2384] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:40.487575 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.498167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915f57-39a7-40f7-b6ca-e78a97d29a41 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.502930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.508606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.508606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.508606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] PATH_INFO: `/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb/users/3125bdb96b1a42eba542eb33122f77dd/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.520347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a067d1edf43e2bf38feeddc19bcbb, user_id=3125bdb96b1a42eba542eb33122f77dd, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.522957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.604975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1199/2385] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:40 2022] PUT /identity/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb/users/3125bdb96b1a42eba542eb33122f77dd/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:40.609661 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.624194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8ea3-cd6e-42d9-83d0-512a28bef4bc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.636899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:40.686967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.687893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.688183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.688588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.689328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.690969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179f13f-b13b-4131-8e4d-448b74acbfe8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.704069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1187/2386] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:40.708235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.719573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06dfa-fa5b-41d5-83e6-c96d4c4b1c66 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.724388 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.725284 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.725572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.725852 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] PATH_INFO: `/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb/users/3125bdb96b1a42eba542eb33122f77dd/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.727825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a067d1edf43e2bf38feeddc19bcbb, user_id=3125bdb96b1a42eba542eb33122f77dd, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.730458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.741771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1200/2387] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:40 2022] PUT /identity/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb/users/3125bdb96b1a42eba542eb33122f77dd/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:40.752477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.752763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.753052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.787161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] MFA Rules not processed for user `3125bdb96b1a42eba542eb33122f77dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:40.788343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:40.865037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1188/2388] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:40.881099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:40.881099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:40.948228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534646-78da-441d-9ccf-5e6e9276cb94 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:40.952625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:40.953354 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:40.953770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:40.954108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:40.968274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:40.970850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:40.972374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:40.993594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1201/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:41.032229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:41.033778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:41.046367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ce653-49f5-4dcf-bbfb-cdae0702107a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:41.050359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:41.052601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:41.052601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:41.052601 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:41.117556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:41.121354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea80840-e8db-4003-9840-92a82d8e8c19 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:41.134402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1189/2390] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:41.155789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:41.157517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:41.222764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba810-2010-47f5-b7c2-44b5a191e1ad service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:41.224658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:41.225487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:41.225775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:41.226049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:41.227854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:41.246959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:41.247263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:41.248123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:41.268156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:41.269677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:41.301206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:41.302715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:41.304022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:41.313442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1202/2391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:14:41.330206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1190/2392] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:41.377753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:41.379251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:41.446892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b816-ae26-490c-9852-9468996c942a service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:41.452784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:41.453424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:41.453708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:41.453985 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:41.462072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:41.463679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a96266-6b13-495f-9701-dd1dba479239 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:41.472459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1203/2393] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:14:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:45.846267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:45.943806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a525bfd-63a5-41d8-af4f-89be9cee79a6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:45.960279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:45.961308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:45.961664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:45.962011 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] PATH_INFO: `/v3/users/772ab51b0527436ba82c87c19d3f8b1c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:45.963366 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=772ab51b0527436ba82c87c19d3f8b1c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:45.965462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:46.177557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:46.178072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:46.178154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:46.197582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:46.198800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:46.206217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1204/2394] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:46.219358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:46.232592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e2e94-a888-421d-9189-eb6f2171f74c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:46.238810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:46.239560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:46.239897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:46.240180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:46.254633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772ab51b0527436ba82c87c19d3f8b1c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:46.255347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772ab51b0527436ba82c87c19d3f8b1c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:46.260164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:46.268123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772ab51b0527436ba82c87c19d3f8b1c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:46.270607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340732b-7250-4b79-9aa3-e0e43e18f42c service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:46.288694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772ab51b0527436ba82c87c19d3f8b1c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:46.291241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1205/2395] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:46.364159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772ab51b0527436ba82c87c19d3f8b1c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:46.371585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1191/2396] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:45 2022] DELETE /identity/v3/users/772ab51b0527436ba82c87c19d3f8b1c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:46.376850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:46.377408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:46.377714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:46.402261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:46.404636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:46.429801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:46.604086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1206/2397] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:46.616884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:46.623448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:46.770928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10aff4-4ee2-413a-9311-f761cacbcbaf admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:46.777640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:46.779875 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:46.780165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:46.780514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:46.795185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:46.795185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:46.829599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1192/2398] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:47.090443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:47.092775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:47.245547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc85cee-4728-4e0d-8267-791fe750e50c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:47.252238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:47.255256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:47.256274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:47.256973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:47.259774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:47.273956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:47.276037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:47.289782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1207/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:47.490965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:47.493092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:47.504565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:47.527059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3d4cd-ff27-468e-926e-4e20415a4cb9 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:47.527059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:47.527059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:47.527059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:47.527385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] PATH_INFO: `/v3/projects/166e784ab7744e62aa89c955024f1eb3` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:47.528866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166e784ab7744e62aa89c955024f1eb3)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:47.531515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:47.643708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166e784ab7744e62aa89c955024f1eb3', 'request_id': 'req-bb12f591-345b-467b-8370-dae0d94b56f6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:47.650891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166e784ab7744e62aa89c955024f1eb3', 'request_id': 'req-bb12f591-345b-467b-8370-dae0d94b56f6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:47.722552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166e784ab7744e62aa89c955024f1eb3', 'request_id': 'req-bb12f591-345b-467b-8370-dae0d94b56f6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:47.738608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] The token cache is being invalidate because project 166e784ab7744e62aa89c955024f1eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:47.739002 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:47.739750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:47.745804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1193/2400] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:47 2022] DELETE /identity/v3/projects/166e784ab7744e62aa89c955024f1eb3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:47.746281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:47.758498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcadb2a-a0c8-4be2-93a9-d6b8fa6f6bae service placement] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:47.832364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:47.833324 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:47.833618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:47.833908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] PATH_INFO: `/v3/users/3125bdb96b1a42eba542eb33122f77dd` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:47.835127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3125bdb96b1a42eba542eb33122f77dd)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:47.837227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:48.022445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3125bdb96b1a42eba542eb33122f77dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:48.023369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3125bdb96b1a42eba542eb33122f77dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:48.025987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:48.124462 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3125bdb96b1a42eba542eb33122f77dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:48.147066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3125bdb96b1a42eba542eb33122f77dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:48.163062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-efc6a80b-3ad0-4f02-8871-128f604e3e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3125bdb96b1a42eba542eb33122f77dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:48.177372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1208/2401] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:47 2022] DELETE /identity/v3/users/3125bdb96b1a42eba542eb33122f77dd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:49.161596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:49.163200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:49.178884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f591-345b-467b-8370-dae0d94b56f6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:49.261491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:49.262811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:49.263320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:49.263800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] PATH_INFO: `/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:49.265098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76a067d1edf43e2bf38feeddc19bcbb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:49.267140 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:49.385302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76a067d1edf43e2bf38feeddc19bcbb', 'request_id': 'req-92928d0f-55dc-4a9a-bda8-6d811770e5c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:49.394381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76a067d1edf43e2bf38feeddc19bcbb', 'request_id': 'req-92928d0f-55dc-4a9a-bda8-6d811770e5c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:49.477319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76a067d1edf43e2bf38feeddc19bcbb', 'request_id': 'req-92928d0f-55dc-4a9a-bda8-6d811770e5c4'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:49.494827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] The token cache is being invalidate because project a76a067d1edf43e2bf38feeddc19bcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:49.495228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:49.499799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-92928d0f-55dc-4a9a-bda8-6d811770e5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:49.501955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1194/2402] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:49 2022] DELETE /identity/v3/projects/a76a067d1edf43e2bf38feeddc19bcbb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:49.506800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:49.507313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:49.507505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:49.535960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:49.538328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:49.642459 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1209/2403] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:49.650244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833367a-7257-4a80-981d-4389959775bd None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:49.650542 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833367a-7257-4a80-981d-4389959775bd None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:49.650829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833367a-7257-4a80-981d-4389959775bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:49.689087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5833367a-7257-4a80-981d-4389959775bd None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:49.690264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5833367a-7257-4a80-981d-4389959775bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:49.704771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1195/2404] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:49.709467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:49.725248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c4b60-d687-4803-ad26-282f1b40ead6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:49.740973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:49.741661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:49.741945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:49.742230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:49.743698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:14:49.743979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:49.746122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:49.771577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1210/2405] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:14:49.774453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833367a-7257-4a80-981d-4389959775bd None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:49.786778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833367a-7257-4a80-981d-4389959775bd None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:49.795363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:49.797308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:49.798170 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:49.798556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:49.799717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:49.801786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:49.806999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:49.926410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1196/2406] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:49 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:49.930943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:49.945754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219efd-cee7-4524-8daf-38aaeb26dcf7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:50.034596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:50.036087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:50.036520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:50.039950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:50.040689 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:50.042823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:50.482493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1211/2407] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:49 2022] POST /identity/v3/users => generated 289 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:50.484276 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:50.498488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aa374-cca1-4b06-9700-eeed89bb3d3b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:50.504751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:50.505740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:50.505972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:50.506350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:50.507202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:50.508958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:50.523503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1197/2408] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:50.527481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:50.554167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359d26a-beaf-4e1e-9cbd-0e6fe99a69ca admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:50.562506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:50.563454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:50.563978 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:50.564259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:50.565087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:50.573347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777839-fe49-43ec-902f-9752047b80f4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:50.586593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1212/2409] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:50.590344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:50.601654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b8654-de05-4620-815d-a9b55d42e353 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:50.613007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:50.614556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:50.615014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:50.615303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] PATH_INFO: `/v3/projects/dd42a0d1dc4e4dcbaea21fb919b1912d/users/fbe711ff455a472e81a76d01a996b30d/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:50.633513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42a0d1dc4e4dcbaea21fb919b1912d, user_id=fbe711ff455a472e81a76d01a996b30d, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:50.636545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:50.719782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1198/2410] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:50 2022] PUT /identity/v3/projects/dd42a0d1dc4e4dcbaea21fb919b1912d/users/fbe711ff455a472e81a76d01a996b30d/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:50.731752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:50.732827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:50.732827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:50.916254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] MFA Rules not processed for user `fbe711ff455a472e81a76d01a996b30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:50.917713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:50.958845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:51.035137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1213/2411] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:14:51.036412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:51.144610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35745a51-6a9f-40d5-bd08-e0f3a7b7a2cc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:51.162104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:51.162836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.165961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.166361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.167682 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:51.171427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:51.274470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:51.275120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1199/2412] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:51 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:51.294220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903e8f-aebe-40e4-8547-ec932a2de067 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:51.446256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:51.447421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.447731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.448009 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.449420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:51.455228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:51.553693 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1214/2413] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:51 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:51.556195 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:51.578305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6595-440e-4fb9-be45-73193256ef08 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:51.588756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:51.589605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.589738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.589948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.590691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:51.593351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:51.626591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1200/2414] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:51.633589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:51.660483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fbc34-3a27-43e8-9e9f-af9ea066b27b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:51.679795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:51.680701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.681149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.681589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.683563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:51.684601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e3f4-9888-4e74-9a50-f7ee8f965f45 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:51.703551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1215/2415] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:51.704406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:51.722110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017589a-7590-4fa7-99a7-5dc314973284 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:51.736312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:51.737556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.737978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.738620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] PATH_INFO: `/v3/projects/097af98111a24f01b2a72b181de1dfe8/users/d1403e9d431c49c0a304e14567ecae78/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.773316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] RBAC: Authorizing `identity:create_grant(project_id=097af98111a24f01b2a72b181de1dfe8, user_id=d1403e9d431c49c0a304e14567ecae78, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:51.776111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:51.876069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1201/2416] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:51 2022] PUT /identity/v3/projects/097af98111a24f01b2a72b181de1dfe8/users/d1403e9d431c49c0a304e14567ecae78/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:51.878245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:51.878547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:51.885524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:51.916190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] MFA Rules not processed for user `d1403e9d431c49c0a304e14567ecae78`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:51.917520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:52.028104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1216/2417] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:52.031563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.138515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:52.151740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1008-6b64-49bf-a952-f6a1a956325c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.157927 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.158178 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.158484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.158840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.159698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.161968 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.301426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1202/2418] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:14:52 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:14:52.302696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.332412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93830e-df2c-4c4e-99bb-172bca3db947 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.335110 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.337391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:52.393149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:52.449641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.451008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.452625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.452625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.458104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.460277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.486435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99622d7a-9cdd-4fbf-aa6d-2fd0ff629fc5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.499635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.500368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.500658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.500957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.502982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:52.524198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.532732 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.540827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1203/2419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:14:52.541745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.543448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:52.565856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f80cc-f8d1-4237-8487-7f4d081f5fd6 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.574503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.578922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1217/2420] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:14:52 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:14:52.579412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.579412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.579412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] PATH_INFO: `/v3/users/d6dad40e92684d1f95fc9b3b0a0337ed` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.579412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6dad40e92684d1f95fc9b3b0a0337ed)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.580691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.585173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.610167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d691a3-3c65-4a4a-8e9e-a93c295970df admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.618168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.619500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.620132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.620679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.621648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.624505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.644972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1218/2421] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:52.645691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.657887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298583cb-2b11-41c5-9d49-f299a8be0d33 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.662497 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.663405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.663726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.664180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] PATH_INFO: `/v3/projects/4ab55883bf3c4dea9ef21092ea964daf/users/3bf43beac4d04bfcb274ac04c7934038/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.691701 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab55883bf3c4dea9ef21092ea964daf, user_id=3bf43beac4d04bfcb274ac04c7934038, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.694345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.816913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1219/2422] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:52 2022] PUT /identity/v3/projects/4ab55883bf3c4dea9ef21092ea964daf/users/3bf43beac4d04bfcb274ac04c7934038/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:52.818146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.845876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6dad40e92684d1f95fc9b3b0a0337ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:52.847424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6dad40e92684d1f95fc9b3b0a0337ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:52.861070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6dad40e92684d1f95fc9b3b0a0337ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:52.884790 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6dad40e92684d1f95fc9b3b0a0337ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:52.930230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5df34-f642-479b-bd33-1226aa4c5800 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:52.935604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:52.936285 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:52.936625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:52.936899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:52.937630 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:52.939286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:52.955727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1220/2423] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:14:52.959969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:52.960656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a5a3617e-a344-454d-8c21-5f16f86e1f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6dad40e92684d1f95fc9b3b0a0337ed'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:52.968771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1204/2424] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:52 2022] DELETE /identity/v3/users/d6dad40e92684d1f95fc9b3b0a0337ed => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:52.984815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85272-a570-4aeb-8b67-cdf75829c40a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:53.077918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:53.079192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:53.079482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:53.079787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] PATH_INFO: `/v3/projects/4ab55883bf3c4dea9ef21092ea964daf/users/3bf43beac4d04bfcb274ac04c7934038/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:53.081803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab55883bf3c4dea9ef21092ea964daf, user_id=3bf43beac4d04bfcb274ac04c7934038, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:53.084708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:53.108880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1221/2425] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:14:52 2022] PUT /identity/v3/projects/4ab55883bf3c4dea9ef21092ea964daf/users/3bf43beac4d04bfcb274ac04c7934038/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:53.184943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:53.185247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:53.186226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:53.214940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] MFA Rules not processed for user `3bf43beac4d04bfcb274ac04c7934038`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:14:53.216235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:53.251164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:53.265123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:53.267775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:53.294368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:53.335432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1205/2426] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:14:53.344827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:53.353523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:53.416260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ce44-0da9-4233-a071-e8baa1ad8264 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:53.422957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:53.424219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:53.424982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:53.425377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] PATH_INFO: `/v3/projects/ef58e682b96f4a2cb0b35ad6eee991e5` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:53.427494 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef58e682b96f4a2cb0b35ad6eee991e5)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:53.431235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:53.494814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8bae-5edf-4a78-8188-6756d2ae0a82 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:53.501230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:53.502125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:53.502651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:53.503273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:53.506839 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:53.548033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'request_id': 'req-0d1d4363-3300-4be7-b099-14c4a4967eb3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:53.599398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:53.601023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:53.603671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'request_id': 'req-0d1d4363-3300-4be7-b099-14c4a4967eb3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:53.617081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'request_id': 'req-0d1d4363-3300-4be7-b099-14c4a4967eb3'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:53.626984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1206/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:53.637517 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] The token cache is being invalidate because project ef58e682b96f4a2cb0b35ad6eee991e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:53.637814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:53.639336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:53.645796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1222/2428] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:53 2022] DELETE /identity/v3/projects/ef58e682b96f4a2cb0b35ad6eee991e5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:53.646439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:53.661945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c53ce-49fe-4d45-ba44-998d1447442a service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:53.770524 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:53.771559 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:53.772551 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:53.772962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] PATH_INFO: `/v3/users/3b3b9be963a24419a7272382a76918d1` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:53.776847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3b9be963a24419a7272382a76918d1)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:53.777030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:53.810084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:54.030068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3b9be963a24419a7272382a76918d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:54.031383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3b9be963a24419a7272382a76918d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:54.042359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3b9be963a24419a7272382a76918d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:54.070003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3b9be963a24419a7272382a76918d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:54.157522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3b9be963a24419a7272382a76918d1'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:54.167692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1207/2429] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:14:53 2022] DELETE /identity/v3/users/3b3b9be963a24419a7272382a76918d1 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:14:54.681967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:54.683942 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:54.699308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d4363-3300-4be7-b099-14c4a4967eb3 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:54.780992 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:54.781861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:54.782150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:54.782429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] PATH_INFO: `/v3/projects/f39b93456085458c8771d457d2130cf9` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:54.783713 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39b93456085458c8771d457d2130cf9)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:54.785848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:54.894691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:54.901068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39b93456085458c8771d457d2130cf9', 'request_id': 'req-19ad2b95-6b85-4f81-89f1-ffed93abda3c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:55.044330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39b93456085458c8771d457d2130cf9', 'request_id': 'req-19ad2b95-6b85-4f81-89f1-ffed93abda3c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:55.051274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39b93456085458c8771d457d2130cf9', 'request_id': 'req-19ad2b95-6b85-4f81-89f1-ffed93abda3c'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:55.066620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] The token cache is being invalidate because project f39b93456085458c8771d457d2130cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:14:55.066917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:55.067997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:14:55.069803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1223/2430] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:14:54 2022] DELETE /identity/v3/projects/f39b93456085458c8771d457d2130cf9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:14:56.103596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:56.105029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:56.182322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1a3c-0b77-4a5f-a523-ada0f36f048b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:56.240480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:56.241134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:56.241416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:56.241715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:56.243479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:56.308752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:56.310361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:56.320440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1208/2431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:14:58.044379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:14:58.046590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:58.059917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2b95-6b85-4f81-89f1-ffed93abda3c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:14:58.063950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:14:58.064922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:14:58.065397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:14:58.065837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:14:58.067747 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:14:58.142377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:14:58.143880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb2835-94ff-4b45-a7c4-776e347ca906 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:14:58.155111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1224/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:14:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:15:02.647154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:02.648629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:02.667452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:02.729867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e11aa4-71b4-46a4-8690-4e8c5135ed9f service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:02.735232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:02.736138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:02.736427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:02.736712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] PATH_INFO: `/v3/users/fbe711ff455a472e81a76d01a996b30d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:02.737928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe711ff455a472e81a76d01a996b30d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:02.739957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:02.995729 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe711ff455a472e81a76d01a996b30d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:02.996342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe711ff455a472e81a76d01a996b30d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.003956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe711ff455a472e81a76d01a996b30d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.016266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe711ff455a472e81a76d01a996b30d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.094747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe711ff455a472e81a76d01a996b30d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.101700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1209/2433] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:15:02 2022] DELETE /identity/v3/users/fbe711ff455a472e81a76d01a996b30d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:03.106268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:03.106760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:03.106859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:03.124902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:03.126091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:03.186857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1225/2434] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:15:03.196654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:03.198071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:03.256988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942723-fc24-441a-b6a2-7b0d590a4be2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:03.260599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:03.261240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:03.261526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:03.261800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:03.272899 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:03.274357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:03.285070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1210/2435] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:15:03.708315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:03.718221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:03.722862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89323843-3b8c-4e67-bd05-e7c75b9d4184 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:03.729341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:03.730438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:03.730918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:03.731490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] PATH_INFO: `/v3/projects/dd42a0d1dc4e4dcbaea21fb919b1912d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:03.732771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd42a0d1dc4e4dcbaea21fb919b1912d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:03.735087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:03.846243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd42a0d1dc4e4dcbaea21fb919b1912d', 'request_id': 'req-88488c4a-343b-4e11-8bb8-c6f3d47ee970'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.925679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd42a0d1dc4e4dcbaea21fb919b1912d', 'request_id': 'req-88488c4a-343b-4e11-8bb8-c6f3d47ee970'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.929671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:03.931897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd42a0d1dc4e4dcbaea21fb919b1912d', 'request_id': 'req-88488c4a-343b-4e11-8bb8-c6f3d47ee970'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.944552 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] The token cache is being invalidate because project dd42a0d1dc4e4dcbaea21fb919b1912d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:15:03.944850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.945559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:03.947093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1226/2436] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:15:03 2022] DELETE /identity/v3/projects/dd42a0d1dc4e4dcbaea21fb919b1912d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:15:03.951265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:03.961958 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf967-13f2-4918-a03d-fafbde9759d1 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:03.993008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:04.024248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:04.025114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:04.025415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:04.025685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] PATH_INFO: `/v3/users/d1403e9d431c49c0a304e14567ecae78` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:04.026860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1403e9d431c49c0a304e14567ecae78)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:04.028798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:04.241684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1403e9d431c49c0a304e14567ecae78'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:04.242888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1403e9d431c49c0a304e14567ecae78'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:04.251925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1403e9d431c49c0a304e14567ecae78'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:04.267566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1403e9d431c49c0a304e14567ecae78'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:04.631471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1403e9d431c49c0a304e14567ecae78'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:04.637811 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1211/2437] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:15:03 2022] DELETE /identity/v3/users/d1403e9d431c49c0a304e14567ecae78 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:05.119442 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:05.121357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:05.137472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488c4a-343b-4e11-8bb8-c6f3d47ee970 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:05.207846 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:05.209121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:05.209471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:05.209815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] PATH_INFO: `/v3/projects/097af98111a24f01b2a72b181de1dfe8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:05.211063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097af98111a24f01b2a72b181de1dfe8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:05.213123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:05.307236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097af98111a24f01b2a72b181de1dfe8', 'request_id': 'req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.363449 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097af98111a24f01b2a72b181de1dfe8', 'request_id': 'req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.369557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097af98111a24f01b2a72b181de1dfe8', 'request_id': 'req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.383028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] The token cache is being invalidate because project 097af98111a24f01b2a72b181de1dfe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:15:05.383325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.384004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.385647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1227/2438] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:15:05 2022] DELETE /identity/v3/projects/097af98111a24f01b2a72b181de1dfe8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:05.389767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:05.392149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:05.405084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ebd4-f224-4f80-b6c3-0157797a745e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:05.462929 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:05.464315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:05.464315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:05.464538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] PATH_INFO: `/v3/users/3bf43beac4d04bfcb274ac04c7934038` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:05.465591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf43beac4d04bfcb274ac04c7934038)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:05.467585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:05.645638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf43beac4d04bfcb274ac04c7934038'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.646294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf43beac4d04bfcb274ac04c7934038'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.650858 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:05.653859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf43beac4d04bfcb274ac04c7934038'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.666539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf43beac4d04bfcb274ac04c7934038'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.723006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c40dc510-22e5-4220-8b85-22a1ac39e8aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf43beac4d04bfcb274ac04c7934038'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:05.729539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1212/2439] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:15:05 2022] DELETE /identity/v3/users/3bf43beac4d04bfcb274ac04c7934038 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:15:06.184487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:06.186041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:06.215215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8dd90-47b5-4e0f-8449-3dab67e3ee32 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:06.268168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:06.269048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.269333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.269719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] PATH_INFO: `/v3/projects/4ab55883bf3c4dea9ef21092ea964daf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.271053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab55883bf3c4dea9ef21092ea964daf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:06.273007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:06.300634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:06.393231 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab55883bf3c4dea9ef21092ea964daf', 'request_id': 'req-6edafb13-3d07-429d-a092-8f25ed833aee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:06.461238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab55883bf3c4dea9ef21092ea964daf', 'request_id': 'req-6edafb13-3d07-429d-a092-8f25ed833aee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:06.468022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab55883bf3c4dea9ef21092ea964daf', 'request_id': 'req-6edafb13-3d07-429d-a092-8f25ed833aee'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:06.479781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] The token cache is being invalidate because project 4ab55883bf3c4dea9ef21092ea964daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:15:06.480219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:06.480887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6edafb13-3d07-429d-a092-8f25ed833aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:06.482429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1228/2440] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:15:06 2022] DELETE /identity/v3/projects/4ab55883bf3c4dea9ef21092ea964daf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:06.488581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.489119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.489220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.508725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:06.510189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:06.584075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1213/2441] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:06.591919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.592215 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.592558 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.612131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:06.613435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:06.621806 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1229/2442] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:06.626884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:06.637242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526b506-d5b8-4203-a16c-23d5a0bde0f6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:06.642967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:06.643672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.643964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.644247 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.644995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:15:06.645315 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:06.646919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:06.659908 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1214/2443] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:15:06.664590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:06.674204 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099b6a1-1c17-47d0-9191-2ad117e62326 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:06.678911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:06.679625 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.679915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.680191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.681264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:06.687289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:06.782182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1230/2444] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:15:06 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:15:06.786604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:06.798484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262f3aa-48b4-44cb-927b-ad9a56281bfe admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:06.863859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:06.864592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.864881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.865162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.865888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:06.867909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:06.972004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1215/2445] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:15:06 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:15:06.976311 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:06.987768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2386c-5d5c-456b-9c80-878de2f5e213 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:06.994295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:06.994968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:06.995256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:06.995654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:06.996456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:06.998213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:07.010191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1231/2446] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:15:07.014223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:07.024871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d87ed-87d4-4477-86f8-168b35434fa9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:07.029804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:07.030231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.030491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.030774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.032257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:07.033864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97fef0-dc35-47b4-8c78-b008223d0d40 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:07.044485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1216/2447] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:15:07.048904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:07.058883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc63150-d899-4ef3-bcce-56f9ad4b2156 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:07.063957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:07.064901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.065192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.065468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] PATH_INFO: `/v3/projects/4371ab80a5c24636a6cb3c27d5af6b2a/users/8ea27283f4f1403e8f186f78639f2ebf/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.081507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4371ab80a5c24636a6cb3c27d5af6b2a, user_id=8ea27283f4f1403e8f186f78639f2ebf, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:07.084542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:07.238798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1232/2448] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:15:07 2022] PUT /identity/v3/projects/4371ab80a5c24636a6cb3c27d5af6b2a/users/8ea27283f4f1403e8f186f78639f2ebf/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:15:07.249222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375448c-2dc8-4961-84bc-3651d9d46235 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.249517 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375448c-2dc8-4961-84bc-3651d9d46235 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.249798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375448c-2dc8-4961-84bc-3651d9d46235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.280530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c375448c-2dc8-4961-84bc-3651d9d46235 None None] MFA Rules not processed for user `8ea27283f4f1403e8f186f78639f2ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:07.282847 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c375448c-2dc8-4961-84bc-3651d9d46235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:07.313302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:07.361097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1217/2449] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:07.369604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:07.371364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:07.431259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fa368-bc88-4889-8c6b-c38a98600a1e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:07.432850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808d14-d327-4aab-bb90-e094288975cb None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.433148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808d14-d327-4aab-bb90-e094288975cb None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.433433 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808d14-d327-4aab-bb90-e094288975cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.435010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:07.435727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.436013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.436293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.445595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:07.447041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:07.455277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5f808d14-d327-4aab-bb90-e094288975cb None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:07.456337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1233/2450] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:15:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:15:07.459129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5f808d14-d327-4aab-bb90-e094288975cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:07.521530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1218/2451] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:15:07.533535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:07.534927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:07.590893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:07.608913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b9552-b6ff-4825-b596-272dc54230c9 service glance] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:07.614698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:07.615353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:07.615672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:07.615951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:07.624264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:07.627763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:07.637471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1234/2452] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:15:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:15:17.513614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=41 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:17.734283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=9 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:24.955382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:24.956536 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:24.957096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:24.976574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:24.977784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:24.986294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1219/2453] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:15:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:25.000199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:25.011411 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4527a-d518-40b3-8707-771f89cc8cea service swift] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:25.017307 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:25.017966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:25.018240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:25.019191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:25.027810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:25.037673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa027b-e994-403b-b6b6-2e2bc3c5b2ae service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:25.040086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1235/2454] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:15:34.969804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:35.035408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:54.099379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:54.161320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2858a2-b147-4f0d-b32c-470b62f52a6b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:54.165851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:54.166712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:54.166993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:54.167266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] PATH_INFO: `/v3/users/8ea27283f4f1403e8f186f78639f2ebf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:54.168469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea27283f4f1403e8f186f78639f2ebf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:54.170368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:54.360508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea27283f4f1403e8f186f78639f2ebf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:54.361177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea27283f4f1403e8f186f78639f2ebf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:54.368210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea27283f4f1403e8f186f78639f2ebf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:54.380617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea27283f4f1403e8f186f78639f2ebf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:54.443637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea27283f4f1403e8f186f78639f2ebf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:54.449637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1220/2455] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:15:54 2022] DELETE /identity/v3/users/8ea27283f4f1403e8f186f78639f2ebf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:15:54.454030 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:54.455038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:54.455038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:54.472777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:54.474134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:54.536903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1236/2456] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:54.542988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:54.546889 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:54.605093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9614-a86d-4848-951f-56ef4f2a67a3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:54.611008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:54.611008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:54.611008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:54.611008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:54.619491 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:54.620944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30717862-b48f-4a8b-9aa1-52edc84d3372 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:54.631012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1221/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:15:55.062774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.064318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:55.076825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08ea2b-f6ad-4cc5-9335-18accf9cd305 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.081622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.082501 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.082782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.083056 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] PATH_INFO: `/v3/projects/4371ab80a5c24636a6cb3c27d5af6b2a` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.084273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4371ab80a5c24636a6cb3c27d5af6b2a)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.086192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.193691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4371ab80a5c24636a6cb3c27d5af6b2a', 'request_id': 'req-55768531-8258-4317-a9bd-fd9f87fbce97'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:55.256014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4371ab80a5c24636a6cb3c27d5af6b2a', 'request_id': 'req-55768531-8258-4317-a9bd-fd9f87fbce97'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:55.262243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4371ab80a5c24636a6cb3c27d5af6b2a', 'request_id': 'req-55768531-8258-4317-a9bd-fd9f87fbce97'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:55.273783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] The token cache is being invalidate because project 4371ab80a5c24636a6cb3c27d5af6b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:15:55.274076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:55.274742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-55768531-8258-4317-a9bd-fd9f87fbce97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:15:55.276362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1237/2458] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:15:55 2022] DELETE /identity/v3/projects/4371ab80a5c24636a6cb3c27d5af6b2a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:55.281194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.281653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.281767 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.300558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:55.302581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:55.319212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:55.360692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1222/2459] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:55.368937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.369240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.369526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.388214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:55.389559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:55.397392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1238/2460] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:55.401520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.412608 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc597bd-2a20-4bc9-89c9-723a610514c5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.417248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.417898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.418189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.418470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.419186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:15:55.419498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.421373 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.433750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1223/2461] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:15:55.437921 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.447482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9778a-9523-46e7-81b3-82e88fc15799 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.452170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.452814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.453101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.453380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.454076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.456003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.565428 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1239/2462] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:15:55 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:15:55.570459 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.580503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877976-df41-4e7a-a34f-8fc813d0ab4e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.638746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.639425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.639748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.640034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.640736 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.642646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.734895 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1224/2463] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:15:55 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:15:55.739742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.749998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f50e1e-4685-4dc5-a8da-4c5d6f2b03f1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.755515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.756244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.756551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.756836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.757559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.759153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.769692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1240/2464] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:15:55.773719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.783799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465bbb8-6499-44a5-928b-76593c84dce1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.788687 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.789343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.789625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.789898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.790613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.792225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645ccbe-b50f-4924-ae45-390a5467d606 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.802869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1225/2465] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:15:55.806811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:55.817423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545087-6d41-47fc-b888-2a89ab6c4b63 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:55.822293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:55.826082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.826082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.826082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] PATH_INFO: `/v3/projects/4d69bf03f62e4bb28481e5f6b4061464/users/862defb578e7407f9d6220846a5d369d/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.838277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d69bf03f62e4bb28481e5f6b4061464, user_id=862defb578e7407f9d6220846a5d369d, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:55.840954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:55.952787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1241/2466] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:15:55 2022] PUT /identity/v3/projects/4d69bf03f62e4bb28481e5f6b4061464/users/862defb578e7407f9d6220846a5d369d/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:15:55.963090 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938969-b60c-4d5e-9e69-49e70158392f None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:55.963387 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938969-b60c-4d5e-9e69-49e70158392f None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:55.963703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938969-b60c-4d5e-9e69-49e70158392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:55.990518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d4938969-b60c-4d5e-9e69-49e70158392f None None] MFA Rules not processed for user `862defb578e7407f9d6220846a5d369d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:55.991779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d4938969-b60c-4d5e-9e69-49e70158392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:56.059345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1226/2467] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:15:56.069720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:15:56.071320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:56.092588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:56.127913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b457-02b4-4419-9360-f0d62b3bbb38 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:15:56.132105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:15:56.132753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:56.133070 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:56.133353 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:56.141753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:15:56.143786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:15:56.152208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1242/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:15:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:15:57.789320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:15:57.789848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:15:57.789955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:15:57.807768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] MFA Rules not processed for user `862defb578e7407f9d6220846a5d369d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:15:57.808982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:15:57.815819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1227/2469] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:06.191869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=17 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:07.802218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:13.100188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:13.102337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:13.170549 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a3a04-379d-4840-a05f-6f4396ea9e29 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:13.174670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:13.175323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:13.175673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:13.175948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:13.178771 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:13.244931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:13.246281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:13.257425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1243/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:17.961218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:17.963351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:17.984933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c405f-3e0a-432d-a6f1-798eecc5e4f7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:17.990042 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:17.990980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:17.991264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:17.991552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] PATH_INFO: `/v3/users/15aec8f2f71e4084a21cc0cfc3a52bd2` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:17.992900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15aec8f2f71e4084a21cc0cfc3a52bd2)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:17.994800 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:18.235888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15aec8f2f71e4084a21cc0cfc3a52bd2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.236545 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15aec8f2f71e4084a21cc0cfc3a52bd2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.243951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15aec8f2f71e4084a21cc0cfc3a52bd2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.255799 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15aec8f2f71e4084a21cc0cfc3a52bd2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.352655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-0313d36c-d7e2-4305-8296-346287adabc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15aec8f2f71e4084a21cc0cfc3a52bd2'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.360200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1228/2471] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:17 2022] DELETE /identity/v3/users/15aec8f2f71e4084a21cc0cfc3a52bd2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:18.640082 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:18.650524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25453-b774-492d-ac6d-4f8b657a4819 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:18.710970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:18.711892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:18.712179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:18.712528 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] PATH_INFO: `/v3/projects/217a93e9314e4b06ae49a36a9969e22e` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:18.713620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217a93e9314e4b06ae49a36a9969e22e)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:18.716884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:18.832265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217a93e9314e4b06ae49a36a9969e22e', 'request_id': 'req-9c70eab8-67be-4d7c-ab49-622db2f41891'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.834995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:18.918572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217a93e9314e4b06ae49a36a9969e22e', 'request_id': 'req-9c70eab8-67be-4d7c-ab49-622db2f41891'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.928447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217a93e9314e4b06ae49a36a9969e22e', 'request_id': 'req-9c70eab8-67be-4d7c-ab49-622db2f41891'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.937938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] The token cache is being invalidate because project 217a93e9314e4b06ae49a36a9969e22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:18.938232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.938900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9c70eab8-67be-4d7c-ab49-622db2f41891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:18.940546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1244/2472] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:18 2022] DELETE /identity/v3/projects/217a93e9314e4b06ae49a36a9969e22e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:18.945754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:18.946056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:18.946341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:18.967594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:18.968955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:19.052637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1229/2473] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:19.053611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.053905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.054186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.079052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:19.080826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:19.101830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1245/2474] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:19.106342 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.115906 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d7dd-9db9-4983-a2b7-598852fad3f1 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.122683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.123422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.123741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.124051 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.124786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:19.125100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.126708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.142485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1230/2475] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:16:19.147254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.157042 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c87c9-b172-4951-a12d-0b3c174c332b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.162257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.163100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.163251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.163511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.164435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.166585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.258275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1246/2476] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:19 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:19.262644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.273241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5df99-af93-4cf5-8f7a-b18f36248692 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.331093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.331802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.332094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.332375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.333761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.336068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.342814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:19.439810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1231/2477] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:19 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:19.446704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.457443 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63793d94-1479-41a8-a580-cb82c6cde0c2 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.463021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.463721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.464010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.464287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.465010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.466602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.477397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1247/2478] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:19.481527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.491986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f37892-cc28-4dad-9dab-971e82029de9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.497277 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.497992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.498282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.498564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.499341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.501222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aa3af-1677-4f15-a998-930c9f834a39 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.512742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1232/2479] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:19.517035 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.527262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f900c-e647-4847-b228-2a4366c34bc6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.531881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.532753 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.533040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.533320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] PATH_INFO: `/v3/projects/580a3f003c704fcc9a8fd68365213245/users/1b16a20fc435446e9eafc93cd242eb81/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.548417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580a3f003c704fcc9a8fd68365213245, user_id=1b16a20fc435446e9eafc93cd242eb81, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.551029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.610277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1248/2480] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:19 2022] PUT /identity/v3/projects/580a3f003c704fcc9a8fd68365213245/users/1b16a20fc435446e9eafc93cd242eb81/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:19.621561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.621859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.622144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.650210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] MFA Rules not processed for user `1b16a20fc435446e9eafc93cd242eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:19.651435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:19.718038 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1233/2481] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:19.728537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:19.730259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:19.804875 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fdd6-08d6-44ff-8813-cecb5a4c41e5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:19.810687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:19.813887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:19.813887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:19.813887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:19.821522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:19.823111 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:19.832110 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1249/2482] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:20.630296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:20.631981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:20.699053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765d98-4832-4616-823a-4f2bb6e8cd4c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:20.703348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:20.704046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:20.704409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:20.704692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:20.706636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:20.773375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:20.775352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:20.785702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1234/2483] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:21.417229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:21.418728 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:21.431676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f898f7e-fbbe-455c-bae3-1158c0df28a6 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:21.435573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:21.436224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:21.436514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:21.436874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:21.438878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:21.450904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:21.452351 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36d66-702a-4775-a868-c221e52e998e service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:21.462843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1250/2484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:23.308212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:23.313590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a785a2-c9de-435d-ac03-4e099b942b78 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:23.331452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:23.332934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:23.333667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:23.334188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] PATH_INFO: `/v3/users/1b16a20fc435446e9eafc93cd242eb81` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:23.344584 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b16a20fc435446e9eafc93cd242eb81)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:23.347017 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:23.371621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:23.595721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b16a20fc435446e9eafc93cd242eb81'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:23.597792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b16a20fc435446e9eafc93cd242eb81'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:23.610439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b16a20fc435446e9eafc93cd242eb81'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:23.652091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b16a20fc435446e9eafc93cd242eb81'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:23.718676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b16a20fc435446e9eafc93cd242eb81'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:23.728724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1235/2485] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:23 2022] DELETE /identity/v3/users/1b16a20fc435446e9eafc93cd242eb81 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:23.735510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:23.736029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:23.736130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:23.756236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:23.757899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:23.815712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:23.838340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1251/2486] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:23.845272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:23.847671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:23.937368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6f7b-7b7a-43eb-8b64-13749ad428e8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:23.941300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:23.942050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:23.943385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:23.943981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:23.955637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:23.958018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15cc8b-3422-42bb-a070-b8029a9d700c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:23.975632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1236/2487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:24.453230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:24.454752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:24.485132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0da7-4bdc-430a-9b79-7da181b707bc None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:24.490233 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:24.491310 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:24.491699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:24.492050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] PATH_INFO: `/v3/projects/580a3f003c704fcc9a8fd68365213245` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:24.493300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=580a3f003c704fcc9a8fd68365213245)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:24.495268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:24.658687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580a3f003c704fcc9a8fd68365213245', 'request_id': 'req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:24.735794 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580a3f003c704fcc9a8fd68365213245', 'request_id': 'req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:24.779586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580a3f003c704fcc9a8fd68365213245', 'request_id': 'req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:24.787628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] The token cache is being invalidate because project 580a3f003c704fcc9a8fd68365213245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:24.788108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:24.789007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-884c6f3c-6e1d-44d6-9f61-6b7167cdbf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:24.790928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1252/2488] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:24 2022] DELETE /identity/v3/projects/580a3f003c704fcc9a8fd68365213245 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:24.796050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:24.796606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:24.796830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:24.860698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:24.861869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:24.997607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1237/2489] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:25.006266 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd371-850e-486d-8043-0d3a64585e25 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.006640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd371-850e-486d-8043-0d3a64585e25 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.007007 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd371-850e-486d-8043-0d3a64585e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.029512 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-cd4dd371-850e-486d-8043-0d3a64585e25 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:25.030891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cd4dd371-850e-486d-8043-0d3a64585e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:25.044509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.047053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1253/2490] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:25.058204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250d531-d7b2-468d-891e-c850e6e0b0db None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.076355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.077091 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.077383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.077668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.078078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.078412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:25.078538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.078726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.078879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.080391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.097812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1238/2491] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:16:25.103149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.108922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:25.110518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:25.119420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef0a5-4517-4d1e-95af-c1c671003772 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.121953 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.122933 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.124213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.124663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.125715 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.128311 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.289248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1254/2492] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:25.480560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:25.500903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.501402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1239/2493] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:25 2022] POST /identity/v3/projects => generated 405 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:25.506003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.506183 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:25.640440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a74ac-b2ea-4b36-ba9c-5e2aa2fdaa28 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.652498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.653193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.653520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.653751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.657969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f2d2-43b9-449a-bd3a-a36df1b7d7cf None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.659632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.663088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.670398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:25.770480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1240/2494] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:25 2022] POST /identity/v3/users => generated 303 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:25.773724 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.784662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.786092 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.786613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.787062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.788503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76daf4-cd56-47e5-a3af-dab0e0f0e0ec admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.796563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.799291 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.799838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.804336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.804336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.804336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.817795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1241/2495] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:25.822003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.836566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78615b2f-9a31-4777-be04-42d02befd6aa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.841329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.841994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.842279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.842556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.843283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.845089 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.857716 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.859793 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1242/2496] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:25.863105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7247d-ecfa-416c-aa75-4912c5803986 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:25.863615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:25.873346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1255/2497] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:25.881307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b051-d386-43b4-95e6-b06d5e2eb5e6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:25.887785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:25.896394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:25.896394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:25.896394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] PATH_INFO: `/v3/projects/18b1a9fefc7d4c24a51fa38b57288c4d/users/182bdb61619a4643bbd4b8ee6d358e8f/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:25.926271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b1a9fefc7d4c24a51fa38b57288c4d, user_id=182bdb61619a4643bbd4b8ee6d358e8f, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:25.929386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:26.066515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1243/2498] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:25 2022] PUT /identity/v3/projects/18b1a9fefc7d4c24a51fa38b57288c4d/users/182bdb61619a4643bbd4b8ee6d358e8f/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:26.077752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:26.078178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:26.078522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:26.135175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] MFA Rules not processed for user `182bdb61619a4643bbd4b8ee6d358e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:26.135175 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:26.286975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:26.291418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:26.306697 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1256/2499] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:26.321160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:26.323947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:26.382189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db89c-af24-4f2e-901c-bf8ac48ef6c5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:26.386979 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:26.387887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:26.388174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:26.388585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] PATH_INFO: `/v3/users/288ab671062d409f98b91aeacde8b5fc` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:26.389777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=288ab671062d409f98b91aeacde8b5fc)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:26.391873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:26.405376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4388b-3eb4-4448-b8d6-2bde9d509c6c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:26.414821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:26.415829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:26.416119 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:26.416397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] PATH_INFO: `/v3/users/9c620175b84d4cee9aef398864c03c8d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:26.417644 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c620175b84d4cee9aef398864c03c8d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:26.419510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:26.523357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:26.585681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:26.588513 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288ab671062d409f98b91aeacde8b5fc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.589184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288ab671062d409f98b91aeacde8b5fc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.599634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288ab671062d409f98b91aeacde8b5fc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.625623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288ab671062d409f98b91aeacde8b5fc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.640456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c620175b84d4cee9aef398864c03c8d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.641667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c620175b84d4cee9aef398864c03c8d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.718798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288ab671062d409f98b91aeacde8b5fc'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.726762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1244/2500] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:26 2022] DELETE /identity/v3/users/288ab671062d409f98b91aeacde8b5fc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:26.731229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:26.731229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:26.793454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c620175b84d4cee9aef398864c03c8d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.810013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c620175b84d4cee9aef398864c03c8d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.817194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b0af-c073-4b2e-9125-1e900d6107cc admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:26.819795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c620175b84d4cee9aef398864c03c8d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:26.825562 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:26.826658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:26.827047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:26.827420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:26.828582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1257/2501] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:26 2022] DELETE /identity/v3/users/9c620175b84d4cee9aef398864c03c8d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:26.828739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:26.830898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d03b1-7dfa-40ed-8f89-016c5313cd8b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:26.936596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1245/2502] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:26 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:26.940968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:26.943800 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:26.988330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:26.994365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:26.994365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.009534 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.010913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.022664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157761a-4027-4f2a-9c3c-315a5d3e9a9a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.069560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1246/2503] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.082274 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.084381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.084964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.085653 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.085945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.086224 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.086929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.088972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.152184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:27.158147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae52d7-1fd0-4f4a-a5c3-655c97081674 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.164050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.164813 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.165108 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.165391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.179575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.182012 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.190907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1247/2504] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:27.194359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.195759 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.200186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:27.205695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1258/2505] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:26 2022] POST /identity/v3/users => generated 309 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:27.213584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.214123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883bf5a-f3fc-4b7c-9b1d-027cada161cc service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.221598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.222470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.223152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.223653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] PATH_INFO: `/v3/projects/2b88389a00a342e285e0c31b90368f87` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.224579 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01d5c-09b7-44a4-ab33-e458d02c4386 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.224849 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b88389a00a342e285e0c31b90368f87)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.226786 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.230186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.230862 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.233953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.233953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.233953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.233953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.245496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1259/2506] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:27.250099 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.264044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e3b3a-ab21-403c-8e18-0e2d08a015b7 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.268807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.269830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.270305 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.270714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] PATH_INFO: `/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b/users/93c87bd27ee04b31a4ee998dbfb68dc6/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.287344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0d42ffe3884f1ca112b49daa4e409b, user_id=93c87bd27ee04b31a4ee998dbfb68dc6, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.290483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.365830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1260/2507] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:27 2022] PUT /identity/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b/users/93c87bd27ee04b31a4ee998dbfb68dc6/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:27.366850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.368603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.373785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b88389a00a342e285e0c31b90368f87', 'request_id': 'req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.382133 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b88389a00a342e285e0c31b90368f87', 'request_id': 'req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.433304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d35c-22cf-477d-b110-55c179d0bff3 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.438184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b88389a00a342e285e0c31b90368f87', 'request_id': 'req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.452859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] The token cache is being invalidate because project 2b88389a00a342e285e0c31b90368f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:27.453259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.454001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.455587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1248/2508] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:27 2022] DELETE /identity/v3/projects/2b88389a00a342e285e0c31b90368f87 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:27.456499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.457876 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.495275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.496170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.496452 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.496726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] PATH_INFO: `/v3/projects/d6db503a0a1749789e92ed63f5a113b7` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.497916 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6db503a0a1749789e92ed63f5a113b7)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.499958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.529021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9a5ca-02fe-4aec-8a4d-b4b43ac6ffee admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.534649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.535349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.535668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.536495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.537272 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.538896 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82a2b-333d-4059-a89f-8ac448bbbb27 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.549817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1249/2509] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:27.551072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.551399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.552052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.570814 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.572052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.577380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6db503a0a1749789e92ed63f5a113b7', 'request_id': 'req-c5e4532a-4798-468f-866e-88ea96229a3e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.624165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:27.627336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6db503a0a1749789e92ed63f5a113b7', 'request_id': 'req-c5e4532a-4798-468f-866e-88ea96229a3e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.637937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1250/2510] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.638074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6db503a0a1749789e92ed63f5a113b7', 'request_id': 'req-c5e4532a-4798-468f-866e-88ea96229a3e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.638918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.650434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1f35-8b11-4569-9e95-3e18835d0fe4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.656331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.658281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.658281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.658281 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] PATH_INFO: `/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b/users/93c87bd27ee04b31a4ee998dbfb68dc6/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.659631 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] The token cache is being invalidate because project d6db503a0a1749789e92ed63f5a113b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:27.659817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0d42ffe3884f1ca112b49daa4e409b, user_id=93c87bd27ee04b31a4ee998dbfb68dc6, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.660048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.661384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c5e4532a-4798-468f-866e-88ea96229a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:27.663118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4109ab-0868-4de9-a935-1e1d933e58a5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.667444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1261/2511] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:27 2022] DELETE /identity/v3/projects/d6db503a0a1749789e92ed63f5a113b7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:27.667444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381428-03a6-40c3-ac13-207d9ffdd7b9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.667444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381428-03a6-40c3-ac13-207d9ffdd7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.667444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381428-03a6-40c3-ac13-207d9ffdd7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.673317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:27.675298 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1251/2512] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:27 2022] PUT /identity/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b/users/93c87bd27ee04b31a4ee998dbfb68dc6/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:27.676050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4f85-6ac5-4b88-a3d0-79c753898cfa None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.676347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4f85-6ac5-4b88-a3d0-79c753898cfa None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.677975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4f85-6ac5-4b88-a3d0-79c753898cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.688394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-88381428-03a6-40c3-ac13-207d9ffdd7b9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.689533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-88381428-03a6-40c3-ac13-207d9ffdd7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.696179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-3f1b4f85-6ac5-4b88-a3d0-79c753898cfa None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.697416 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-3f1b4f85-6ac5-4b88-a3d0-79c753898cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.753686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1262/2513] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.755259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f14952-ac70-471e-bb48-548180c83639 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.755586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f14952-ac70-471e-bb48-548180c83639 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.755868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f14952-ac70-471e-bb48-548180c83639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.759572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1252/2514] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.761599 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.761966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.762288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.780589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.781841 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.783329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-14f14952-ac70-471e-bb48-548180c83639 None None] MFA Rules not processed for user `93c87bd27ee04b31a4ee998dbfb68dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.784527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-14f14952-ac70-471e-bb48-548180c83639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.839730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1253/2515] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.840581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.853036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad6880-740e-4343-ad1a-3bfae571d0b5 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.855926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1263/2516] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.857254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.857545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.858018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.858159 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.858769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.859149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.859499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.860266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:27.860574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.862171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.876684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1254/2517] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:27.877427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.877871 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:27.879098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.879232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.887932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1264/2518] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:27.888824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.890078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:27.953589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf395-5532-4ef0-be7b-0b1ff3c611b8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.956379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f455-260a-4160-a84e-79af96ba0462 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.959959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.960640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.964094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.964219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.964324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.964418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.964418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.964418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.969773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.971379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.971655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:27.973086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:27.980319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1255/2519] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:27.983020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.984657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1265/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:27.985572 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:27.991476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030eabee-b309-4414-b93c-b25dcf7b6478 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:27.996550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:27.997450 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:27.997742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:27.998034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:27.998734 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.000701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.003739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687ffd1-a9fb-4f38-bee0-7b2bf43e3c39 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.009362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:28.010890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.011792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.012247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.012685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.013405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:28.013714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.015313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.034676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1266/2521] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:28.035450 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.046890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1de82-7216-47b5-88f3-ec033f600554 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.051911 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.052564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.052849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.053126 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.053824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.055896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.066760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:28.116074 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1256/2522] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:27 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:28.120124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.163706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1267/2523] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:28.163706 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.165423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.187353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674e389-ec9c-4564-bd87-f583d8206627 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.228990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2443dd-11ca-4705-a5f0-6bc4eae073f3 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.233835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.234707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.234991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.235270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] PATH_INFO: `/v3/users/182bdb61619a4643bbd4b8ee6d358e8f` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.236525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=182bdb61619a4643bbd4b8ee6d358e8f)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.238488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.245263 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.245936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.247991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.247991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.247991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.249199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.344988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1257/2524] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:28.344988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.355059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0972558-2bcf-4e60-9bd0-28bbe9f22dce admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.360006 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.360648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.361030 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.361316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.361994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.364640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.446539 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1258/2525] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:28.450621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.457465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182bdb61619a4643bbd4b8ee6d358e8f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:28.458692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182bdb61619a4643bbd4b8ee6d358e8f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:28.463212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74da3d-87dc-4f77-a9ed-be19e252f7b7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.468111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.468723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.469007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.469287 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.470056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.471893 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.485374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1259/2526] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:28.485374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.485374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.502092 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b084b-9a99-49d2-b5e1-e7a17633294e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.507594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.508409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.508761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.509044 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.509766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.511410 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.526750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1260/2527] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:28.527620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.529443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.541356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182bdb61619a4643bbd4b8ee6d358e8f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:28.543690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdf52d-d6c8-4f4c-9a5f-44a11923d2e5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.548782 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.550796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.550796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.550796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.550796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.552783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.558715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182bdb61619a4643bbd4b8ee6d358e8f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:28.566326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182bdb61619a4643bbd4b8ee6d358e8f'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:28.570949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1261/2528] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:28.570949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.576854 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1268/2529] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:28 2022] DELETE /identity/v3/users/182bdb61619a4643bbd4b8ee6d358e8f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:28.577639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.580499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb12517-bd4e-41c5-94e1-7718c1187c18 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.613246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:28.644663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.646114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.647166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.647506 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.648369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.649951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154299-dcc0-4c1b-95a9-ac7481cc965f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.650384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4492ba9-55d8-40cf-ad53-62b0f1040b0c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.655841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.657118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.657496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.657790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] PATH_INFO: `/v3/projects/99ce1bcc28564be287a065c1938b57ca/users/66bb4ab897754cf0b32bb95f23f5c664/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.670665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1262/2530] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:28.670665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.670665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.670665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.680485 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:28.683946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ce1bcc28564be287a065c1938b57ca, user_id=66bb4ab897754cf0b32bb95f23f5c664, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.686649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919c85d-e29e-4058-b810-8ef4b7e07acb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.688327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:28.690344 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.699665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1263/2531] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:28.700389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.713411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b4b6-99c7-44b9-9492-a6e198710778 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.718529 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.719345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.719668 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.719949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] PATH_INFO: `/v3/projects/16a8719266f24b71b3b759de1ffb5546/users/cf8bda048ea14579b7e8aae3b4d4af12/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.734526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a8719266f24b71b3b759de1ffb5546, user_id=cf8bda048ea14579b7e8aae3b4d4af12, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.737179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a231c-21d8-410b-a991-db0f8dfdc071 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.743195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1269/2532] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:28 2022] PUT /identity/v3/projects/99ce1bcc28564be287a065c1938b57ca/users/66bb4ab897754cf0b32bb95f23f5c664/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:28.748255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.748255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.748255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.763085 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:28.764338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.818108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1270/2533] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:28.818956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.820430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.833279 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1264/2534] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:28 2022] PUT /identity/v3/projects/16a8719266f24b71b3b759de1ffb5546/users/cf8bda048ea14579b7e8aae3b4d4af12/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:28.834698 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.835094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.835508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.860131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:28.861343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.881189 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d77f7c-68f4-4d3f-b107-efd96a96baca None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:28.930521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1265/2535] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:28.931400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:28.932913 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:28.942642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:28.943377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.951825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.951825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.953760 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:28.955196 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a657e-782c-4e04-9bd1-5669723843de service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:28.965478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1271/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:28.966765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:28.967063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:28.967341 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:28.997535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] MFA Rules not processed for user `cf8bda048ea14579b7e8aae3b4d4af12`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:28.999038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:29.012912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2076d2-00e4-4796-9947-2b475d764e4d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.019656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.020440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.020708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.021008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.058128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:29.075005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:29.082917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1272/2537] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:29.083908 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.093300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b2620-ae64-4480-91b7-fe5ece3d5b73 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.096113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.097199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.097721 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.097831 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.098104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.098973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.107711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1266/2538] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:29.111003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.116826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.117837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.125779 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5a232-d381-4c8f-8dcf-073190200572 service swift] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.135621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.136338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.136604 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.136877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.137566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.138922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1273/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:29.139451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.224466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1267/2540] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:29 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:29.232737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.244518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2ab3-5e78-44b5-b302-6c8821af86fe service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.335361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.336073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.336358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.336633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.337352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.339691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.452096 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.454530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:29.454954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1274/2541] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:29 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:29.458634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.473869 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2c55a-f29a-4f87-951c-410796f1b1e2 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.475067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639f14-a848-429c-b539-318c1c7572b9 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.485683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.486041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.486795 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.488669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.488669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.489412 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.494209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.494209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.495225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.495225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] PATH_INFO: `/v3/projects/18b1a9fefc7d4c24a51fa38b57288c4d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.497320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b1a9fefc7d4c24a51fa38b57288c4d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.500510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.519139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1275/2542] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:29.520585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.538059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311bba-e708-4d4e-82da-bb4998f45b08 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.544358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.545330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.545619 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.546405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] PATH_INFO: `/v3/projects/8e7f8527a3344363b94133d12ce0a7af/users/be24095a87ef442cab2ef8a1adc26150/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.569583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7f8527a3344363b94133d12ce0a7af, user_id=be24095a87ef442cab2ef8a1adc26150, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.572990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.680814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1276/2543] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:29 2022] PUT /identity/v3/projects/8e7f8527a3344363b94133d12ce0a7af/users/be24095a87ef442cab2ef8a1adc26150/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:29.685430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.700151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b1a9fefc7d4c24a51fa38b57288c4d', 'request_id': 'req-88810ab4-6537-40d7-a594-f18e7790fcf3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:29.712567 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b1a9fefc7d4c24a51fa38b57288c4d', 'request_id': 'req-88810ab4-6537-40d7-a594-f18e7790fcf3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:29.786557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c32d3-0b2c-428f-8e01-fe1ca4c6ad4f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.816308 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b1a9fefc7d4c24a51fa38b57288c4d', 'request_id': 'req-88810ab4-6537-40d7-a594-f18e7790fcf3'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:29.822838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:29.838310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] The token cache is being invalidate because project 18b1a9fefc7d4c24a51fa38b57288c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:29.838310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:29.838310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:29.838643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1268/2544] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:29 2022] DELETE /identity/v3/projects/18b1a9fefc7d4c24a51fa38b57288c4d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:29.842888 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.844772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:29.851408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.852194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.852395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.852676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.853545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.855441 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.862770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88810ab4-6537-40d7-a594-f18e7790fcf3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.867216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1277/2545] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:29.871337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:29.872664 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.873165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:29.874005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.875564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.875564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] PATH_INFO: `/v3/users/93c87bd27ee04b31a4ee998dbfb68dc6` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.876706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c87bd27ee04b31a4ee998dbfb68dc6)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.878914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.886947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01671753-cf92-42d5-81ca-24f13d2d2350 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:29.892163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:29.893210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.893564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.894044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] PATH_INFO: `/v3/projects/8e7f8527a3344363b94133d12ce0a7af/users/be24095a87ef442cab2ef8a1adc26150/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.896367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7f8527a3344363b94133d12ce0a7af, user_id=be24095a87ef442cab2ef8a1adc26150, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:29.899145 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b35722-8585-4196-b1cd-e1d4a8544177 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:29.917699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1278/2546] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:29 2022] PUT /identity/v3/projects/8e7f8527a3344363b94133d12ce0a7af/users/be24095a87ef442cab2ef8a1adc26150/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:29.926993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:29.927484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:29.927803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:29.955796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] MFA Rules not processed for user `be24095a87ef442cab2ef8a1adc26150`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:29.957038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:30.032245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1279/2547] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:30.041493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:30.043115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:30.103803 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c87bd27ee04b31a4ee998dbfb68dc6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:30.104547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c87bd27ee04b31a4ee998dbfb68dc6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:30.122951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d89843-0c76-4333-8b28-ecd4372b8885 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:30.126989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:30.127678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:30.127971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:30.128245 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:30.131338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c87bd27ee04b31a4ee998dbfb68dc6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:30.138496 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:30.139975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:30.149336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c87bd27ee04b31a4ee998dbfb68dc6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:30.152676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1280/2548] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:30.232762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e46bc31f-a826-4806-aadb-168d0ee5a8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c87bd27ee04b31a4ee998dbfb68dc6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:30.239850 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1269/2549] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:29 2022] DELETE /identity/v3/users/93c87bd27ee04b31a4ee998dbfb68dc6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:30.820670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:30.900133 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:30.927429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff07c8-8a86-49fc-9bdc-1f6cfb71ee0a service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:30.942853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:30.943405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:30.943405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:30.968498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:30.971623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] MFA Rules not processed for user `66bb4ab897754cf0b32bb95f23f5c664`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:30.973109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:30.999389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.000578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.001419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.001419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] PATH_INFO: `/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.002514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0d42ffe3884f1ca112b49daa4e409b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.004623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.058475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1270/2550] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:31.065260 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.067004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.082154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107ca93-2786-4eea-9daa-8830fce06a95 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.087705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.087946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.088556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.088902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.089996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.092088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.128003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0d42ffe3884f1ca112b49daa4e409b', 'request_id': 'req-0b278753-de9d-4f1f-aaa5-baaab10e7513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.175130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0d42ffe3884f1ca112b49daa4e409b', 'request_id': 'req-0b278753-de9d-4f1f-aaa5-baaab10e7513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.182520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0d42ffe3884f1ca112b49daa4e409b', 'request_id': 'req-0b278753-de9d-4f1f-aaa5-baaab10e7513'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.183479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1271/2551] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:31.184500 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.188066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.196513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] The token cache is being invalidate because project 8e0d42ffe3884f1ca112b49daa4e409b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:31.196803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.197633 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.199223 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1281/2552] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:30 2022] DELETE /identity/v3/projects/8e0d42ffe3884f1ca112b49daa4e409b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:31.200086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.201435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.253302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87356972-e6d5-4c27-b213-98090ee872a2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.259312 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.260215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.260503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.260783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] PATH_INFO: `/v3/users/cf8bda048ea14579b7e8aae3b4d4af12` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.261978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8bda048ea14579b7e8aae3b4d4af12)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.263952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.267473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278753-de9d-4f1f-aaa5-baaab10e7513 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.272156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.272820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.273103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.273377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.274072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.276024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5b3bb-178d-4cfe-aa42-0dc835e07874 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.353627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1282/2553] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:31.354970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.355261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.355556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.374262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:31.377776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.383762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1283/2554] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:31.384530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.390433 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:31.394118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe144b-0970-4fd4-8249-3d256bd4dc22 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.399045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.399717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.400005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.400280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.401020 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.402632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c09b6-cb0d-4fab-8b4d-8cfd5aedeedb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.412874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1284/2555] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:31.414103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.414397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.414671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.432973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:31.434155 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.442072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1285/2556] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:31.442072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.453629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb06475-45c1-4d17-a500-a24a57337418 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.458394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.459260 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.459688 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.459932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] PATH_INFO: `/v3/projects/cbce26607d244e0c9b0b86965e46e929/users/a2100b1edecb47139fbc509797afed99/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.460134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8bda048ea14579b7e8aae3b4d4af12'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.460905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8bda048ea14579b7e8aae3b4d4af12'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.467816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8bda048ea14579b7e8aae3b4d4af12'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.476848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbce26607d244e0c9b0b86965e46e929, user_id=a2100b1edecb47139fbc509797afed99, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.479508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.481097 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8bda048ea14579b7e8aae3b4d4af12'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.558331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8bda048ea14579b7e8aae3b4d4af12'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:31.560981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:31.564179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1286/2557] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:31 2022] PUT /identity/v3/projects/cbce26607d244e0c9b0b86965e46e929/users/a2100b1edecb47139fbc509797afed99/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:31.567642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.567812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1272/2558] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:31 2022] DELETE /identity/v3/users/cf8bda048ea14579b7e8aae3b4d4af12 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:31.568904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.570149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.571475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.634622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa6d-67a6-4c60-9c25-8de753d0cf73 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.636053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187038a8-c33b-4e34-a444-163398851033 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.639602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.640313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.640597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.640781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.640906 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.641411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.641564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:31.641680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.641872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.642028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.642740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.643671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.644355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d8d57-204b-4af1-960c-9cafa44e7d71 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.655101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1273/2559] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:31.657823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1287/2560] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:31.659248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.659853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.660048 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.660326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.670596 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34b805-c794-4f7d-8747-2f6be004003f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.675989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.677474 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.677758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.682458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] PATH_INFO: `/v3/projects/cbce26607d244e0c9b0b86965e46e929/users/a2100b1edecb47139fbc509797afed99/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.682458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbce26607d244e0c9b0b86965e46e929, user_id=a2100b1edecb47139fbc509797afed99, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.682725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.682844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:31.683980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.691795 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1274/2561] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:31.693148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.698525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1288/2562] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:31 2022] PUT /identity/v3/projects/cbce26607d244e0c9b0b86965e46e929/users/a2100b1edecb47139fbc509797afed99/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:31.710666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7fb37-7445-42a8-a4ad-1b552235472e None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.716974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.718835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.772236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.773029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.773320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.773597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.774314 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.776246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.781320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135cadb-a12a-44a5-b74a-1ce889f2db55 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.785368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.786232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.786923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.787075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.797158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.798889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:31.815184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1289/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:31.878146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1275/2564] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:31.883340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.894682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec82e3-68f5-424d-9037-f4911477c84b service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:31.933382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:31.935290 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:31.947253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:31.961590 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:31.962659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:31.962965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:31.963359 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:31.964108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:31.966008 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.001699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4aa5-8609-4cf5-bf90-6c0b393e01aa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.007020 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.008016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.008301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.008577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] PATH_INFO: `/v3/users/862defb578e7407f9d6220846a5d369d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.009762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=862defb578e7407f9d6220846a5d369d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.011694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.027435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:32.088834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1290/2565] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:31 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:32.090309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.105703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300e24-07dd-4f14-8c9b-fe39fef969de admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.110842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.112157 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.113040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.113529 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.115925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.117613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.129303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1291/2566] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:32.136736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.150431 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d599f-e9f7-43a5-a53f-704b0a09591e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.157243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.158302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.158951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.158951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.159704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.161836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.174301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1292/2567] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:32.179515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.190591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c40a-5640-4543-9b87-49e0547d85a8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.196117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.197076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.197843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.198198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] PATH_INFO: `/v3/projects/8d3aeb08daaa44e3b76f96cbcb069ded/users/830e512c6a7c430983984768c8ed148b/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.213417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3aeb08daaa44e3b76f96cbcb069ded, user_id=830e512c6a7c430983984768c8ed148b, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.216286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.262980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862defb578e7407f9d6220846a5d369d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.263677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862defb578e7407f9d6220846a5d369d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.270482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862defb578e7407f9d6220846a5d369d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.281987 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862defb578e7407f9d6220846a5d369d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.321032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1293/2568] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:32 2022] PUT /identity/v3/projects/8d3aeb08daaa44e3b76f96cbcb069ded/users/830e512c6a7c430983984768c8ed148b/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:32.321294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.328029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.369719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-eac50ec0-0829-4814-a679-6410445bcf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862defb578e7407f9d6220846a5d369d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.377297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1276/2569] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:31 2022] DELETE /identity/v3/users/862defb578e7407f9d6220846a5d369d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:32.381832 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079b0f-a6bf-4fc6-917e-4e4a34b142e9 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.382126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079b0f-a6bf-4fc6-917e-4e4a34b142e9 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.382407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079b0f-a6bf-4fc6-917e-4e4a34b142e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.414117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230eff-64fa-4252-8604-f7fc522caf07 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.431625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0f079b0f-a6bf-4fc6-917e-4e4a34b142e9 None None] MFA Rules not processed for user `830e512c6a7c430983984768c8ed148b`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:32.433073 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0f079b0f-a6bf-4fc6-917e-4e4a34b142e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.509849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.510766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.511172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.511615 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] PATH_INFO: `/v3/projects/16a8719266f24b71b3b759de1ffb5546` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.512878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a8719266f24b71b3b759de1ffb5546)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.514931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.526372 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1277/2570] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:32.528222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.528526 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.528806 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.549962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:32.551317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.559385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1278/2571] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:32.560168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.561408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.574035 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d02e2-1483-4c61-8592-ece7c681d107 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.578882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.579613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.579910 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.580205 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.580882 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.583379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.686347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:32.694990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a8719266f24b71b3b759de1ffb5546', 'request_id': 'req-59320db7-f3ad-4ec6-9ae9-f063275195a5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.712488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1279/2572] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:32 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:32.714872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.718118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.781348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0f0a8-298a-4bf0-9815-751d7a03b155 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.785025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.785665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.786468 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.786745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.798843 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a8719266f24b71b3b759de1ffb5546', 'request_id': 'req-59320db7-f3ad-4ec6-9ae9-f063275195a5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.805690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a8719266f24b71b3b759de1ffb5546', 'request_id': 'req-59320db7-f3ad-4ec6-9ae9-f063275195a5'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.817097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] The token cache is being invalidate because project 16a8719266f24b71b3b759de1ffb5546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:32.817380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.818074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:32.819897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1294/2573] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:32 2022] DELETE /identity/v3/projects/16a8719266f24b71b3b759de1ffb5546 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:32.820586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.823671 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.837914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:32.861069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.863088 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.874455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1280/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:32.875299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:32.876809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:32.890099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a641-33dc-4af6-b3af-417642ca7824 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.895239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.896226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.896575 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.896940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] PATH_INFO: `/v3/users/be24095a87ef442cab2ef8a1adc26150` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.897077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320db7-f3ad-4ec6-9ae9-f063275195a5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:32.898254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=be24095a87ef442cab2ef8a1adc26150)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.900521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:32.907809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:32.918817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:32.918817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:32.918817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:32.918817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:32.918817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.011727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1295/2575] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:32 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:33.015574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.026268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066632-2216-4419-9721-86cd94ebeb4c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.031087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.031817 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.032195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.032407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.033356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.035448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.046150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1296/2576] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:33.050626 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.056826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be24095a87ef442cab2ef8a1adc26150'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.062907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be24095a87ef442cab2ef8a1adc26150'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.063037 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dad98-ece5-4b2c-975d-f19014032f06 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.065413 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be24095a87ef442cab2ef8a1adc26150'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.068972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.069877 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.070161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.070447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] PATH_INFO: `/v3/projects/8097a6a160b249a9a4449619fc7846d3/users/9e072f9140c54a7f9070f81584b6b07d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.080541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be24095a87ef442cab2ef8a1adc26150'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.088251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8097a6a160b249a9a4449619fc7846d3, user_id=9e072f9140c54a7f9070f81584b6b07d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.093290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.187936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be24095a87ef442cab2ef8a1adc26150'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.196951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1281/2577] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:32 2022] DELETE /identity/v3/users/be24095a87ef442cab2ef8a1adc26150 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:33.198008 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.215264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.228408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1297/2578] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:33 2022] PUT /identity/v3/projects/8097a6a160b249a9a4449619fc7846d3/users/9e072f9140c54a7f9070f81584b6b07d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:33.233683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.236856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.320961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f7025-baba-4a62-b695-55181e0e1ddb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.337726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e1229-aedf-44ab-80c8-9754ed34cf27 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.342761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.343456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.343929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.344326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.345118 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.347202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04a920-a5bc-4a22-a9df-043cb37cf966 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.361887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1298/2579] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:33.363521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.363880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.364337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.380756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.381627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.381915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.382197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] PATH_INFO: `/v3/projects/4d69bf03f62e4bb28481e5f6b4061464` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.383398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d69bf03f62e4bb28481e5f6b4061464)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.385565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.391796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] MFA Rules not processed for user `a2100b1edecb47139fbc509797afed99`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:33.393012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.398592 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:33.466265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1299/2580] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:33.467256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.479367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07980321-89ef-46a3-92eb-04fb6410043b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.484988 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.486344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.486673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.486946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] PATH_INFO: `/v3/projects/8097a6a160b249a9a4449619fc7846d3/users/9e072f9140c54a7f9070f81584b6b07d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.489879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8097a6a160b249a9a4449619fc7846d3, user_id=9e072f9140c54a7f9070f81584b6b07d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.493423 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e3cc-ac9a-4a2e-8d67-630b27ebec0e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.503112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d69bf03f62e4bb28481e5f6b4061464', 'request_id': 'req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.507104 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1300/2581] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:33 2022] PUT /identity/v3/projects/8097a6a160b249a9a4449619fc7846d3/users/9e072f9140c54a7f9070f81584b6b07d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:33.511787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d69bf03f62e4bb28481e5f6b4061464', 'request_id': 'req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.518823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.519125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.519478 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.549785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] MFA Rules not processed for user `9e072f9140c54a7f9070f81584b6b07d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:33.551014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.559326 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:33.576439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d69bf03f62e4bb28481e5f6b4061464', 'request_id': 'req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.591396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] The token cache is being invalidate because project 4d69bf03f62e4bb28481e5f6b4061464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:33.591738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.592428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-38bcc9f1-4cf8-42d9-85e9-092aacd94c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.594488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1282/2582] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:33 2022] DELETE /identity/v3/projects/4d69bf03f62e4bb28481e5f6b4061464 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:33.600530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.611094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.611094 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.621583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:33.623052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.648758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1301/2583] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:33.661521 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.662982 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.702853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1283/2584] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:33.705060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.706558 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.722826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5a50a-f1f1-4ddb-a5f5-9be72a0aa636 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.729349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.730214 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.730492 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.730794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] PATH_INFO: `/v3/projects/8e7f8527a3344363b94133d12ce0a7af` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.732299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7f8527a3344363b94133d12ce0a7af)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.734206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.745837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5e954-2f05-4d20-a2da-d8e7bc19bf94 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.750699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.751436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.751748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.752025 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.766743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.766743 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed682d-9c23-401e-87c9-67116a71d7dd service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.773708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1302/2585] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:33.775071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.775437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.775801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.796398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:33.798391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:33.808041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1303/2586] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:33.813499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.825901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413754c-67ba-4ae1-a973-1bb50eb52409 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.840789 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7f8527a3344363b94133d12ce0a7af', 'request_id': 'req-7945b8dd-4af1-4c66-b435-3c82e536d2de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.847662 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7f8527a3344363b94133d12ce0a7af', 'request_id': 'req-7945b8dd-4af1-4c66-b435-3c82e536d2de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.897796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.898461 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.898749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.899026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.899792 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:33.900097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.901690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.917586 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1304/2587] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:16:33.918275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.929676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5799e-2cc0-4f95-8c6b-1965fae554ec admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:33.934674 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:33.935332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:33.935652 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:33.935932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:33.936616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:33.938537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98871b33-1ab5-4e81-9ca8-16c61f0108a3 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:33.969872 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7f8527a3344363b94133d12ce0a7af', 'request_id': 'req-7945b8dd-4af1-4c66-b435-3c82e536d2de'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.983706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] The token cache is being invalidate because project 8e7f8527a3344363b94133d12ce0a7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:33.984029 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.985112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:33.987127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1284/2588] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:33 2022] DELETE /identity/v3/projects/8e7f8527a3344363b94133d12ce0a7af => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:33.992123 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:33.993587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.052730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945b8dd-4af1-4c66-b435-3c82e536d2de admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.057046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.057711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.057970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.058426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.060970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1305/2589] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:33 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:34.061605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.062306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cbad-36f1-4b2f-ac49-0399c2418a1b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.062601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cbad-36f1-4b2f-ac49-0399c2418a1b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.062883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0cbad-36f1-4b2f-ac49-0399c2418a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.086368 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-61e0cbad-36f1-4b2f-ac49-0399c2418a1b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:34.089837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-61e0cbad-36f1-4b2f-ac49-0399c2418a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.126423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.128077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.137422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1285/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:34.138206 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.139496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.155297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1306/2591] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:34.155444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6242-72e3-41ee-a139-1f446b90a947 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.160423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.161663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.161948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.162417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.163049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.165165 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.167602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.167905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.169446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.192143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:34.192143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:34.192143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.203198 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1307/2592] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:34.204299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.216861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b049109-4e6e-4679-9d28-0382a6d2b1a2 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.221979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.222646 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.222937 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.224015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.224618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:34.224931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.226525 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.238445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1308/2593] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:34.243021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.252865 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d4c5-9459-4b04-8f18-983934802898 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.258109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.258757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.259045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.259327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.260052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.261970 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.279203 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1286/2594] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:34.283362 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.293252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161190-6401-4842-b4e9-7f682c876038 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.298901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.299652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.299934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.311024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.311024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.311024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.313861 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1287/2595] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:34.318381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.328116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aea6d2-c6f8-4de1-ada7-b7f0f99f3ac4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.332919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.333975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.333975 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.334242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.334823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.336445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.346945 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1288/2596] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:34.351758 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.361316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1309/2597] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:34.361588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccbb09-5dca-4080-9437-45ffec7d1333 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.364173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.424573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.425461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.425748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.426025 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] PATH_INFO: `/v3/projects/5a011dc568b04d8a91935a613d951b1c/users/eaa2b82129ac4f8796fdd57cad8e0bfb/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.435712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e39f69-985c-4f2e-ba1e-85484f258278 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.440124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a011dc568b04d8a91935a613d951b1c, user_id=eaa2b82129ac4f8796fdd57cad8e0bfb, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.440435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.441095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.441542 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.441820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.443348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.444746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd536f-47f7-47d2-90d8-b17534483c7b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.445303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.558696 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1289/2598] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:34 2022] PUT /identity/v3/projects/5a011dc568b04d8a91935a613d951b1c/users/eaa2b82129ac4f8796fdd57cad8e0bfb/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:34.563886 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.564241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.564592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.583582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:34.584718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.587959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1310/2599] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:34.600236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.626394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1155a-48b9-49e9-a7d4-526405c515da admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.639113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:34.666004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1290/2600] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:34.675775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.678200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.704670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.705458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.705858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.706151 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.706962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.709682 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.721851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1311/2601] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:34.728734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.741876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7293f8-2bad-4dd9-8ada-ed573fbdf911 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.744646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b61fc-d287-4ee1-8b8a-8c4951062fd6 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.755641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.755641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.755641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.756147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.756270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.756381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.756381 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.756578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.756673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.756765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.763250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.764766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1312/2602] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:34.765716 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.769173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.779105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1291/2603] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:34.781325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d752c-79f2-42ad-8dbe-aa2ad8bb42be admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.787379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.788962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.789259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.789546 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] PATH_INFO: `/v3/projects/734ddf43ba1f4a2da25caa0dece6518f/users/f1d85f942dd0482abc6d2e6571c4290d/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.819560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734ddf43ba1f4a2da25caa0dece6518f, user_id=f1d85f942dd0482abc6d2e6571c4290d, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.822403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4560a4b-6805-406d-900e-928fc9f199f8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:34.899737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1313/2604] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:34 2022] PUT /identity/v3/projects/734ddf43ba1f4a2da25caa0dece6518f/users/f1d85f942dd0482abc6d2e6571c4290d/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:34.900045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:34.901597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.911457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.911914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.912199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.916867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2931d4-8270-4adb-9d8b-d8ca24582ad1 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:34.949606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] MFA Rules not processed for user `f1d85f942dd0482abc6d2e6571c4290d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:34.951397 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:34.978760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:34.979679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:34.980131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:34.980388 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] PATH_INFO: `/v3/users/66bb4ab897754cf0b32bb95f23f5c664` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:34.981613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66bb4ab897754cf0b32bb95f23f5c664)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:34.984327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.021742 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1314/2605] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:35.026192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.036749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed265-8d6e-4ffa-9ba9-76c1788cd7dd None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.041399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.042043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.042330 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.042667 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.043360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.045379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.137669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1315/2606] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:35 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:35.141611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.148917 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:35.161645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66bb4ab897754cf0b32bb95f23f5c664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.162365 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66bb4ab897754cf0b32bb95f23f5c664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.169339 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66bb4ab897754cf0b32bb95f23f5c664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.182947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66bb4ab897754cf0b32bb95f23f5c664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.206745 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e99f-0c2d-4fea-802d-97e4d42a7229 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.211468 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.212191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.212484 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.212759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.213467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.215366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.267062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66bb4ab897754cf0b32bb95f23f5c664'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.274783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1292/2607] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:34 2022] DELETE /identity/v3/users/66bb4ab897754cf0b32bb95f23f5c664 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:35.297809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1316/2608] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:35 2022] POST /identity/v3/users => generated 306 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:35.301155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.302936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:35.377695 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b06e-6ab8-4987-88c5-5b03cdf4e765 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.383458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.394103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.394103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.394103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.394103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.394103 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.401651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1293/2609] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:35.403139 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.414983 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf075-5139-48e3-89ca-4f7d6f188285 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.420057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.421038 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.421326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.421610 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] PATH_INFO: `/v3/projects/b55c47825ef046d487309f6bd4edb4c5/users/17727bf932484db2a8782e41d93beb38/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.443465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55c47825ef046d487309f6bd4edb4c5, user_id=17727bf932484db2a8782e41d93beb38, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.447801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.543585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.545508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:35.547079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1317/2610] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:35 2022] PUT /identity/v3/projects/b55c47825ef046d487309f6bd4edb4c5/users/17727bf932484db2a8782e41d93beb38/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:35.556185 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.566874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae060-a14a-4fed-937d-62183041da43 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.634353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.635350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.635807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.642427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] PATH_INFO: `/v3/projects/99ce1bcc28564be287a065c1938b57ca` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.642569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3a3-fae8-4b36-9701-21a9b1ad0ed9 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.642684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ce1bcc28564be287a065c1938b57ca)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.642684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.642860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.642860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.642860 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.643103 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.643882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.646346 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.657932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1318/2611] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:35.662113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.668873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:35.672361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7d7e-1c3b-491c-8f88-1f19e3a357e8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.678570 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.679456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.679773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.680058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] PATH_INFO: `/v3/projects/b55c47825ef046d487309f6bd4edb4c5/users/17727bf932484db2a8782e41d93beb38/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.682066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55c47825ef046d487309f6bd4edb4c5, user_id=17727bf932484db2a8782e41d93beb38, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.684796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d185d-76ed-4ddc-9d72-7ff675438f15 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.702068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1319/2612] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:35 2022] PUT /identity/v3/projects/b55c47825ef046d487309f6bd4edb4c5/users/17727bf932484db2a8782e41d93beb38/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:35.711679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.712232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.712469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.747749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] MFA Rules not processed for user `17727bf932484db2a8782e41d93beb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:35.747749 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:35.790172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ce1bcc28564be287a065c1938b57ca', 'request_id': 'req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.801138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ce1bcc28564be287a065c1938b57ca', 'request_id': 'req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.822974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:35.836923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1320/2613] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:35.850004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.851466 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ce1bcc28564be287a065c1938b57ca', 'request_id': 'req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.851892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:35.869954 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] The token cache is being invalidate because project 99ce1bcc28564be287a065c1938b57ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:35.870439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.871213 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:35.873489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1294/2614] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:35 2022] DELETE /identity/v3/projects/99ce1bcc28564be287a065c1938b57ca => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:35.877210 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:35.879158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:35.915695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c86d7-1a9e-46a9-bae7-9da4a274fd2d None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.951653 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ee62d-e559-4c43-97f9-488cbcdf22a6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:35.957371 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.958364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.958652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.958928 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] PATH_INFO: `/v3/users/a2100b1edecb47139fbc509797afed99` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.960186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2100b1edecb47139fbc509797afed99)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:35.962127 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:35.976657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:35.977005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:35.977294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:35.977580 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:35.979564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:36.047845 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:36.051703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:36.061833 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1321/2615] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:36.114857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2100b1edecb47139fbc509797afed99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.115596 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2100b1edecb47139fbc509797afed99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.118943 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:36.132319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2100b1edecb47139fbc509797afed99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.150469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2100b1edecb47139fbc509797afed99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.199966 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2100b1edecb47139fbc509797afed99'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.227751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1295/2616] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:35 2022] DELETE /identity/v3/users/a2100b1edecb47139fbc509797afed99 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:36.229458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:36.237560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:36.241807 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:36.261685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1174f53-1b4e-4499-bc8c-24effbd3829d service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:36.332177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:36.333084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:36.333384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:36.333853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:36.336309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:36.424166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:36.425664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d985f0-a709-4e8d-8c0b-c2543956f678 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:36.438081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1322/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:36.626379 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:36.627390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:36.639588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:36.746202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672cf02-2be6-485a-b19a-996454526d05 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:36.751697 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:36.752571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:36.752881 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:36.753161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] PATH_INFO: `/v3/projects/cbce26607d244e0c9b0b86965e46e929` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:36.754907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbce26607d244e0c9b0b86965e46e929)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:36.756870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:36.869792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbce26607d244e0c9b0b86965e46e929', 'request_id': 'req-5937b914-fb8a-403b-9109-16c90277a043'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.876275 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbce26607d244e0c9b0b86965e46e929', 'request_id': 'req-5937b914-fb8a-403b-9109-16c90277a043'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.981867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbce26607d244e0c9b0b86965e46e929', 'request_id': 'req-5937b914-fb8a-403b-9109-16c90277a043'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.995963 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] The token cache is being invalidate because project cbce26607d244e0c9b0b86965e46e929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:36.996641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.997926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-5937b914-fb8a-403b-9109-16c90277a043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:36.999521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1296/2618] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:36 2022] DELETE /identity/v3/projects/cbce26607d244e0c9b0b86965e46e929 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:37.004665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.004959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.005241 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.025437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:37.026786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:37.100565 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1323/2619] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:37.107879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.108173 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.108457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.137444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:37.139920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:37.149912 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1297/2620] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:37.154128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.165213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3da49-f8d3-4622-9834-aa3332458e21 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.170268 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.170776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.171062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.171338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.172108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:37.172801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.174393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.187331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1324/2621] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:37.191768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.201270 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ca9e6-75b5-43c7-870e-12d5f7f62f7d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.205967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.206615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.206894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.207171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.208419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.210843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.304192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1298/2622] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:37.308446 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.319639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0f30-9814-40ca-b43d-4c99e5607355 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.389168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.389850 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.390219 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.390412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.391142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.393153 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.487028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1325/2623] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:37.493050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.503632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23f6a-59e6-43a6-ad2e-595ff1189606 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.509354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.510338 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.510633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.510909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.511879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.514056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.545319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1299/2624] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:37.549825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.561176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b4a65-e2d0-4739-9c8e-372ed345e4ef admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.566418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.567925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.568534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.568929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.569730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.571675 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650928f-ee22-47d2-83fc-771cebf112a9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.587791 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:37.592926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:37.603718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1326/2625] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:37.604644 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.616591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2af5-08db-4a81-ae85-6d99a29dafad admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.623623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.624580 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.624878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.625131 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] PATH_INFO: `/v3/projects/4b2e1e6060e54b9f921bee748f4035a6/users/8ca00d802d1c401888bda80064b6493b/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.651250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e1e6060e54b9f921bee748f4035a6, user_id=8ca00d802d1c401888bda80064b6493b, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.654634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:37.769125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1300/2626] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:37 2022] PUT /identity/v3/projects/4b2e1e6060e54b9f921bee748f4035a6/users/8ca00d802d1c401888bda80064b6493b/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:37.780116 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.780418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.781002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.813209 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] MFA Rules not processed for user `8ca00d802d1c401888bda80064b6493b`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:37.814930 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:37.888331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1327/2627] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:37.893222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.923392 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:37.924904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:37.981370 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752633-85b5-4fcf-b886-68dab1768b35 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:37.987199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:37.988024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:37.988192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:37.988477 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:37.989402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:37.991931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.011076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c921fe-01e0-4843-a018-41b49e7c23a7 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.020699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.020699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.021466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.021929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.024246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:38.037012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.038622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.050240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1328/2628] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:38.120804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1301/2629] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:38.125005 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.136480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcdcd-927f-414e-a308-a868c446adb1 service placement] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.206515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.207274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.207650 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.208506 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.215793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.215793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.321851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1329/2630] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:38 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:38.329390 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.371182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4f76e-056a-4a2d-adba-6a25af0139c2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.378827 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.380069 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.380530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.381003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.381742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.384994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.403007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1302/2631] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:38.408124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.419782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423f6-3fdb-4540-b046-24b7d1c7d074 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.425562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.427089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.430086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.430086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.430086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.430329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec797-5bcb-47ca-a556-f46ebc55d318 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.445255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1330/2632] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:38.445672 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.451343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:38.459561 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551014b-66c1-40d9-8ff6-f2dfde82ab9b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.471076 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.472252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.472620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.472965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] PATH_INFO: `/v3/projects/5a1f8545d13e4348afcbb0cc8c9e1f75/users/2223b793789c4a08af33b35b4783100e/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.491120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1f8545d13e4348afcbb0cc8c9e1f75, user_id=2223b793789c4a08af33b35b4783100e, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.494409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.573825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1303/2633] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:38 2022] PUT /identity/v3/projects/5a1f8545d13e4348afcbb0cc8c9e1f75/users/2223b793789c4a08af33b35b4783100e/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:38.585375 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.585683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.586337 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.620534 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] MFA Rules not processed for user `2223b793789c4a08af33b35b4783100e`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:38.621989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:38.673757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:38.704274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1331/2634] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:38.708455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.781452 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3a74d-d1c1-4cec-bfbe-2467a8b36991 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:38.788084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:38.789116 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:38.789414 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:38.789931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:38.790635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:38.793399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:38.937120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1304/2635] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:38 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:38.939108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:38.956002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8853946-d54d-4e20-a092-f3d04b214129 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.041507 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.042202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.042488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.042768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.043469 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.045510 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.157941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1332/2636] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:38 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:39.159325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.171408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a28ea-13ff-4dc9-a53d-273a68339154 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.177455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.178273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.178624 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.179128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.180174 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.184543 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.194055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1305/2637] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:39.198229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.209739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72336d2-8405-4135-84a1-154efe3d25d8 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.215142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.216816 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.217277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.218029 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] PATH_INFO: `/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224/users/0b953495934947e59853bddf17a3a086/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.240081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28dcc4cc96d4be9879b89fc2c7a3224, user_id=0b953495934947e59853bddf17a3a086, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.242929 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.328438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1333/2638] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:39 2022] PUT /identity/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224/users/0b953495934947e59853bddf17a3a086/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:39.329480 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.340844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1088a-8528-41f4-a06c-913a5f246ea7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.432304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.432994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.433282 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.433761 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.434681 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.436973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e7b8-e03d-412b-a170-81b0d0739791 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.448257 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1306/2639] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:39.452642 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.467179 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ac3b5-afa7-4528-9edb-8b81c540364d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.473886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.474925 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.475444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.475876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] PATH_INFO: `/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224/users/0b953495934947e59853bddf17a3a086/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.478550 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28dcc4cc96d4be9879b89fc2c7a3224, user_id=0b953495934947e59853bddf17a3a086, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.481435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.496938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1334/2640] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:39 2022] PUT /identity/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224/users/0b953495934947e59853bddf17a3a086/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:39.508171 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.508614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.508972 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.544475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] MFA Rules not processed for user `0b953495934947e59853bddf17a3a086`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:39.546607 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:39.623034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1307/2641] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:39.635317 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.637166 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:39.685826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:39.702432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b6fe-486a-4d5f-9394-b63f09ed5086 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.706544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.711301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.711301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.711301 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.719004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.720489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab1b45-92e3-47cc-a9ac-5f9e81603d03 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.736593 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1335/2642] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:39.850719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:39.854822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:39.866969 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4ab02-a89e-4059-9011-514002ec2d9c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:39.871437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:39.872200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:39.872496 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:39.872776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:39.933865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:39.935336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:39.945254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1308/2643] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:40.074883 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:40.830681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:40.831180 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:40.831395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:40.882013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] MFA Rules not processed for user `eaa2b82129ac4f8796fdd57cad8e0bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:40.883372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:40.985864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1336/2644] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:40.999980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.001571 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:41.091665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712736-d3f6-4d7b-9b61-88f5a6c057f8 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.096583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.097336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.097708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.098054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.099418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.101467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.235894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1309/2645] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:40 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:41.240445 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.252304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2afde1-c01f-43be-8a23-58da0aa06c41 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.318471 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.323660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.323957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.324236 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.324941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.335169 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.451969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1337/2646] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:41 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:41.456643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.468728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fb00-6936-4440-8480-fdff8ac6b2b0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.474530 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.475246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.482609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.482609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.482609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.482609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.489983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1310/2647] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:41.494269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.504863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870d840-dd53-4980-a007-34b32634aa78 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.509648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.510589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.510879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.511212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] PATH_INFO: `/v3/projects/bddcefb46ba7486c9894d1a16156b69d/users/857a065a54184e0790855e9c2b19d04d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.528390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcefb46ba7486c9894d1a16156b69d, user_id=857a065a54184e0790855e9c2b19d04d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.530964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.664889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1338/2648] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:41 2022] PUT /identity/v3/projects/bddcefb46ba7486c9894d1a16156b69d/users/857a065a54184e0790855e9c2b19d04d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:41.668714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.680356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320d85-83df-4832-bd2b-377aea854920 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.760026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:41.766775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.769335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.769335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.769335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.769335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.771503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.782026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1311/2649] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:41.786999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.799315 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9341a71-fa68-4564-b9fe-0cb487da8974 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:41.805430 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:41.806526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:41.806900 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:41.807275 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] PATH_INFO: `/v3/projects/bddcefb46ba7486c9894d1a16156b69d/users/857a065a54184e0790855e9c2b19d04d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:41.809898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcefb46ba7486c9894d1a16156b69d, user_id=857a065a54184e0790855e9c2b19d04d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:41.813559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7bd1e-9502-44b0-8de1-b99f789d10d6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:41.827163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1339/2650] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:41 2022] PUT /identity/v3/projects/bddcefb46ba7486c9894d1a16156b69d/users/857a065a54184e0790855e9c2b19d04d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:41.969328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:41.971191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:41.986243 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dedc34-ded0-4591-927a-041bb0e2d36b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:42.081909 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:42.083785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:42.084177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:42.085252 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] PATH_INFO: `/v3/users/f1d85f942dd0482abc6d2e6571c4290d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:42.086867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d85f942dd0482abc6d2e6571c4290d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:42.089204 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:42.322437 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d85f942dd0482abc6d2e6571c4290d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:42.323124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d85f942dd0482abc6d2e6571c4290d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:42.330427 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d85f942dd0482abc6d2e6571c4290d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:42.343062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d85f942dd0482abc6d2e6571c4290d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:42.427158 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d85f942dd0482abc6d2e6571c4290d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:42.437196 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1312/2651] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:41 2022] DELETE /identity/v3/users/f1d85f942dd0482abc6d2e6571c4290d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:42.439355 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:42.439868 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:42.439968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:42.461130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:42.465705 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:42.485583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:42.564981 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:42.574079 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1340/2652] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:42.585300 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:42.586744 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:42.716106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b7f30-f259-4f6b-b7e4-2250c5bebb62 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:42.727056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:42.728242 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:42.728727 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:42.729222 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:42.745374 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:42.746957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:42.767502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1313/2653] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:43.322186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:43.324540 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:43.336262 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:43.363045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086e644-d314-4ece-a998-ad3dd9744212 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:43.373437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:43.374490 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:43.374774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:43.375259 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] PATH_INFO: `/v3/projects/734ddf43ba1f4a2da25caa0dece6518f` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:43.376526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734ddf43ba1f4a2da25caa0dece6518f)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:43.378601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:43.513685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734ddf43ba1f4a2da25caa0dece6518f', 'request_id': 'req-cd37d2db-a646-43e0-883a-9245190d0590'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.616256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734ddf43ba1f4a2da25caa0dece6518f', 'request_id': 'req-cd37d2db-a646-43e0-883a-9245190d0590'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.633967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734ddf43ba1f4a2da25caa0dece6518f', 'request_id': 'req-cd37d2db-a646-43e0-883a-9245190d0590'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.636523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] The token cache is being invalidate because project 734ddf43ba1f4a2da25caa0dece6518f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:43.636820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.637504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.639047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1341/2654] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:43 2022] DELETE /identity/v3/projects/734ddf43ba1f4a2da25caa0dece6518f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:43.643369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:43.653714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfadfb-3c1e-408d-a1b7-89b7bc24f2b5 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:43.723363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:43.724944 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:43.725499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:43.726232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] PATH_INFO: `/v3/users/17727bf932484db2a8782e41d93beb38` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:43.727965 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=17727bf932484db2a8782e41d93beb38)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:43.730330 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:43.983294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17727bf932484db2a8782e41d93beb38'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:43.984810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17727bf932484db2a8782e41d93beb38'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:44.003411 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17727bf932484db2a8782e41d93beb38'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:44.021111 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17727bf932484db2a8782e41d93beb38'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:44.090200 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17727bf932484db2a8782e41d93beb38'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:44.102598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1314/2655] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:43 2022] DELETE /identity/v3/users/17727bf932484db2a8782e41d93beb38 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:44.554093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:44.555840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:44.586417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37d2db-a646-43e0-883a-9245190d0590 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:44.694565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:44.698001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:44.786607 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:44.787907 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:44.788206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:44.788487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] PATH_INFO: `/v3/users/8ca00d802d1c401888bda80064b6493b` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:44.789991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca00d802d1c401888bda80064b6493b)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:44.792006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:44.886763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad563a8-79e9-4905-a2ed-ee1f3b3813fb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:44.900139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:44.901024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:44.901337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:44.901615 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] PATH_INFO: `/v3/projects/b55c47825ef046d487309f6bd4edb4c5` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:44.905845 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55c47825ef046d487309f6bd4edb4c5)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:44.907689 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:44.934686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:45.003418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca00d802d1c401888bda80064b6493b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.005044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca00d802d1c401888bda80064b6493b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.009913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:45.142645 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55c47825ef046d487309f6bd4edb4c5', 'request_id': 'req-4a32c8eb-f189-4210-81b8-2b59a47f28cb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.150419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55c47825ef046d487309f6bd4edb4c5', 'request_id': 'req-4a32c8eb-f189-4210-81b8-2b59a47f28cb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.174339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca00d802d1c401888bda80064b6493b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.206394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca00d802d1c401888bda80064b6493b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.221240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-79528aed-c8ea-4406-8ba7-4bc673783a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca00d802d1c401888bda80064b6493b'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.238360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1342/2656] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:44 2022] DELETE /identity/v3/users/8ca00d802d1c401888bda80064b6493b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:45.242821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.243123 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.243440 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.267841 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:45.269171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:45.270083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55c47825ef046d487309f6bd4edb4c5', 'request_id': 'req-4a32c8eb-f189-4210-81b8-2b59a47f28cb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.287632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] The token cache is being invalidate because project b55c47825ef046d487309f6bd4edb4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:45.287934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.289907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-4a32c8eb-f189-4210-81b8-2b59a47f28cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:45.292162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1315/2657] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:44 2022] DELETE /identity/v3/projects/b55c47825ef046d487309f6bd4edb4c5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:45.297572 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd48-d76c-4580-8f1f-16be0340b601 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.298124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd48-d76c-4580-8f1f-16be0340b601 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.298406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd48-d76c-4580-8f1f-16be0340b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.320959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-866acd48-d76c-4580-8f1f-16be0340b601 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:45.322212 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-866acd48-d76c-4580-8f1f-16be0340b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:45.398084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1343/2658] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:45.413962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.416508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:45.458830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1316/2659] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:45.469663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.469980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.470217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.494197 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:45.495710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:45.510768 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1317/2660] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:45.512235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.519651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaadd6-bd35-4703-9070-f39ce17a4a1e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.523897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64443947-7e2e-4054-aa54-64b154f7242b None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.528566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.528859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.529555 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.529840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.530122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.531128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:45.531505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.531821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.532269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.532783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.533328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.548641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1318/2661] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:45.557694 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.557827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.557827 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.565856 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83e06-01de-4f41-8f15-0d764158b23e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.571254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1344/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:45.573737 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.580486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.580486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.580486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.580486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.581922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.706188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1319/2663] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:45 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:45.710605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.726115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f505c7-beee-48f3-80d2-c503fbd15950 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.810830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.812988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:45.824165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.825407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.826270 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.826803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.827882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.830191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.907587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1345/2664] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:45 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:45.912524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.917264 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233eb0-06ef-47ad-bfdb-51df7cc122a5 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.923334 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.924356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.924606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.924890 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] PATH_INFO: `/v3/users/830e512c6a7c430983984768c8ed148b` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.926376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=830e512c6a7c430983984768c8ed148b)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.929669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.935598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925aaa2-1f34-478f-a891-42bd60333998 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.940125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.941194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.941662 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.942739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.944823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.947511 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:45.965998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1346/2665] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:45.970098 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:45.981656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff738c-6fb0-4513-a828-dd8b9b101681 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:45.987888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:45.989987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:45.990451 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:45.990928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:45.992014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:45.993948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:46.008402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1347/2666] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:46.012487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:46.024227 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c5c0-d69f-4cd1-9d20-34f4f1662d1e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:46.032068 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:46.032984 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.033332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.033676 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] PATH_INFO: `/v3/projects/91e063868082477ebf83ebcdcc3e05ed/users/97027db2bc29480ea3f66d44624e1f63/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.053075 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e063868082477ebf83ebcdcc3e05ed, user_id=97027db2bc29480ea3f66d44624e1f63, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:46.056069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:46.218952 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1348/2667] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:46 2022] PUT /identity/v3/projects/91e063868082477ebf83ebcdcc3e05ed/users/97027db2bc29480ea3f66d44624e1f63/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:46.224801 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:46.232842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.308242 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4bd55-bd4b-4dc6-ade4-27f09d22831f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:46.314076 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:46.314777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.315158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.315584 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] PATH_INFO: `/v3/projects/4b2e1e6060e54b9f921bee748f4035a6` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.318013 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2e1e6060e54b9f921bee748f4035a6)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:46.320115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:46.324483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830e512c6a7c430983984768c8ed148b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.325557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830e512c6a7c430983984768c8ed148b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.337773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830e512c6a7c430983984768c8ed148b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.355979 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830e512c6a7c430983984768c8ed148b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.439686 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e1e6060e54b9f921bee748f4035a6', 'request_id': 'req-05d6f159-03e4-41cc-88ed-2a668c105b06'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.445577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:46.448865 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-47dc4376-21eb-4fb7-a3cc-a740418823ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830e512c6a7c430983984768c8ed148b'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.460153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1320/2668] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:45 2022] DELETE /identity/v3/users/830e512c6a7c430983984768c8ed148b => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:46.464777 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.465292 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.465735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.505904 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] MFA Rules not processed for user `97027db2bc29480ea3f66d44624e1f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:46.507481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.535776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e1e6060e54b9f921bee748f4035a6', 'request_id': 'req-05d6f159-03e4-41cc-88ed-2a668c105b06'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.553339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e1e6060e54b9f921bee748f4035a6', 'request_id': 'req-05d6f159-03e4-41cc-88ed-2a668c105b06'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.575814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] The token cache is being invalidate because project 4b2e1e6060e54b9f921bee748f4035a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:46.576424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.581176 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-05d6f159-03e4-41cc-88ed-2a668c105b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.587065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1349/2669] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:46 2022] DELETE /identity/v3/projects/4b2e1e6060e54b9f921bee748f4035a6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:46.587065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.587065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.587065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.608612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:46.610117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.636062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:46.676439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1321/2670] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:46.677826 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:46.679726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.694026 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1350/2671] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:46.695429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:46.696993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.719751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7502-844d-46c6-bfdc-cdabab1a1f13 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:46.730222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:46.730910 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.731200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.731475 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.732343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:46.735923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:46.779049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adf149-b122-4170-9b6b-a18b8c3d9d86 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:46.785525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:46.787746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.788080 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.788440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] PATH_INFO: `/v3/users/2223b793789c4a08af33b35b4783100e` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.789709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2223b793789c4a08af33b35b4783100e)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:46.791995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:46.815825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1351/2672] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:46 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:46.817417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:46.819587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:46.894679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b3ba-2ad9-4e55-acf0-1d6d3539c771 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:46.900524 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:46.901582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:46.902039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:46.902520 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:46.977434 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:46.983010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2223b793789c4a08af33b35b4783100e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.983741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2223b793789c4a08af33b35b4783100e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.994026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2223b793789c4a08af33b35b4783100e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:46.997170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:46.999427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.012185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2223b793789c4a08af33b35b4783100e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.015959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1352/2673] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:47.020367 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.028776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c5a34-98a0-40a9-9543-21e042941129 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.034527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.035710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.036657 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.037396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.038376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.040589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.118923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2223b793789c4a08af33b35b4783100e'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.126218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1322/2674] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:46 2022] DELETE /identity/v3/users/2223b793789c4a08af33b35b4783100e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:47.186205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1353/2675] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:47 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:47.190147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.191917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.284361 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096357-4455-4ccb-879f-9f3f11a857f7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.291902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.292692 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.293115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.293541 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.294509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.296341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.309525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1323/2676] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:47.310174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:47.313487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.325086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27352ddb-011a-4e2d-a5d1-0d79a347d8b5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.332167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.333319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.334974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.334974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] PATH_INFO: `/v3/projects/b0111298113847259cdbe304f699dbe9/users/eb266e95628d4dcd92a4278283ef6cd0/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.356882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0111298113847259cdbe304f699dbe9, user_id=eb266e95628d4dcd92a4278283ef6cd0, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.359989 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.456670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1354/2677] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:47 2022] PUT /identity/v3/projects/b0111298113847259cdbe304f699dbe9/users/eb266e95628d4dcd92a4278283ef6cd0/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:47.461527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.472217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad54b8-a908-4620-a46a-f44761df98b4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.531289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.532059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.532356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.532633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.533485 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.537221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.544997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.546965 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.559773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1324/2678] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:47.564385 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.576331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4667-3209-40ba-b607-88b2badea7d0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.578068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f882ea-0657-48b0-8db4-b74acae1e0b4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.583263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.583631 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.584886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.585177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.585308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.585455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] PATH_INFO: `/v3/projects/8d3aeb08daaa44e3b76f96cbcb069ded` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.585590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.585792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] PATH_INFO: `/v3/projects/b0111298113847259cdbe304f699dbe9/users/eb266e95628d4dcd92a4278283ef6cd0/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.587096 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3aeb08daaa44e3b76f96cbcb069ded)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.588086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0111298113847259cdbe304f699dbe9, user_id=eb266e95628d4dcd92a4278283ef6cd0, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:47.589046 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.590714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381a87b-db96-4bac-8d52-c1bcb5da290d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:47.603593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1325/2679] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:47 2022] PUT /identity/v3/projects/b0111298113847259cdbe304f699dbe9/users/eb266e95628d4dcd92a4278283ef6cd0/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:47.616065 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.616658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.617147 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.679482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] MFA Rules not processed for user `eb266e95628d4dcd92a4278283ef6cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:47.681935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.722744 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3aeb08daaa44e3b76f96cbcb069ded', 'request_id': 'req-c77dc523-98bd-4636-8367-6be1fe992fb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.781490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1326/2680] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:47.795476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.797265 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.837264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3aeb08daaa44e3b76f96cbcb069ded', 'request_id': 'req-c77dc523-98bd-4636-8367-6be1fe992fb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.860493 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3aeb08daaa44e3b76f96cbcb069ded', 'request_id': 'req-c77dc523-98bd-4636-8367-6be1fe992fb0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.869100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fe592-8d14-4f37-9877-4cff6f1d67ae None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.874891 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] The token cache is being invalidate because project 8d3aeb08daaa44e3b76f96cbcb069ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:47.875342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.876144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:47.878158 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1355/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:47 2022] DELETE /identity/v3/projects/8d3aeb08daaa44e3b76f96cbcb069ded => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:47.883057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:47.884858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.940753 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.941676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.942627 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:47.942990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:47.945518 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:47.993427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc523-98bd-4636-8367-6be1fe992fb0 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:47.998589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:47.999627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:47.999990 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:48.000369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] PATH_INFO: `/v3/users/9e072f9140c54a7f9070f81584b6b07d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:48.002032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e072f9140c54a7f9070f81584b6b07d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:48.005022 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:48.050041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:48.052193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:48.066816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1327/2682] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:48.068255 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:48.070027 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:48.084735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc097b-2ca7-4ce7-9b58-c6b89addd312 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:48.090356 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:48.091603 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:48.092049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:48.092527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] PATH_INFO: `/v3/projects/5a1f8545d13e4348afcbb0cc8c9e1f75` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:48.094172 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1f8545d13e4348afcbb0cc8c9e1f75)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:48.096680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:48.203793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e072f9140c54a7f9070f81584b6b07d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.204613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e072f9140c54a7f9070f81584b6b07d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.262207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1f8545d13e4348afcbb0cc8c9e1f75', 'request_id': 'req-d822a659-da77-4935-a6d1-375f3ddf3bda'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.268898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1f8545d13e4348afcbb0cc8c9e1f75', 'request_id': 'req-d822a659-da77-4935-a6d1-375f3ddf3bda'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.296273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e072f9140c54a7f9070f81584b6b07d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.310146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e072f9140c54a7f9070f81584b6b07d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.319186 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e072f9140c54a7f9070f81584b6b07d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.328614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1356/2683] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:47 2022] DELETE /identity/v3/users/9e072f9140c54a7f9070f81584b6b07d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:48.328614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:48.328614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:48.393085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:48.404396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1f8545d13e4348afcbb0cc8c9e1f75', 'request_id': 'req-d822a659-da77-4935-a6d1-375f3ddf3bda'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.425047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] The token cache is being invalidate because project 5a1f8545d13e4348afcbb0cc8c9e1f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:48.425578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.428544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.439363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1328/2684] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:48 2022] DELETE /identity/v3/projects/5a1f8545d13e4348afcbb0cc8c9e1f75 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:48.441368 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:48.449386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:48.468766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debfb7d-a582-4349-aafc-7dfb64c942ab admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:48.475011 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:48.475945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:48.476288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:48.476574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] PATH_INFO: `/v3/users/97027db2bc29480ea3f66d44624e1f63` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:48.477890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97027db2bc29480ea3f66d44624e1f63)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:48.480188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:48.577054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822a659-da77-4935-a6d1-375f3ddf3bda admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:48.584705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:48.586050 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:48.590655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:48.590655 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] PATH_INFO: `/v3/users/0b953495934947e59853bddf17a3a086` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:48.591175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b953495934947e59853bddf17a3a086)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:48.593857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:48.638775 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:48.722685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97027db2bc29480ea3f66d44624e1f63'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.724206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97027db2bc29480ea3f66d44624e1f63'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.833147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97027db2bc29480ea3f66d44624e1f63'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.861481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97027db2bc29480ea3f66d44624e1f63'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.871923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-26e5a966-cf5a-4116-ad8a-9e394f0c0649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97027db2bc29480ea3f66d44624e1f63'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.879583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1357/2685] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:48 2022] DELETE /identity/v3/users/97027db2bc29480ea3f66d44624e1f63 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:48.885093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c1a41-7aec-4ada-b0ee-1dcf2c341f09 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:48.885301 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b953495934947e59853bddf17a3a086'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.886562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c1a41-7aec-4ada-b0ee-1dcf2c341f09 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:48.886842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b953495934947e59853bddf17a3a086'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.887201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c1a41-7aec-4ada-b0ee-1dcf2c341f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:48.913591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b953495934947e59853bddf17a3a086'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:48.914848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5a7c1a41-7aec-4ada-b0ee-1dcf2c341f09 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:48.916302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5a7c1a41-7aec-4ada-b0ee-1dcf2c341f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:48.946016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b953495934947e59853bddf17a3a086'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.043776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1358/2686] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:49.054972 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.055567 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.055960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.092165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] MFA Rules not processed for user `857a065a54184e0790855e9c2b19d04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:49.093383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.142155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b953495934947e59853bddf17a3a086'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.150833 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1329/2687] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:48 2022] DELETE /identity/v3/users/0b953495934947e59853bddf17a3a086 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:49.152533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.153649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.238238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1359/2688] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:49.239149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.240651 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.257763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3a3e0-3687-4b64-9812-1ee09168032b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.284010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f247a9-df56-4160-8edb-b56b2445e55f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.290067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.291053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.291486 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.292059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.294509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.350326 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.351665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.351954 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.352289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] PATH_INFO: `/v3/projects/8097a6a160b249a9a4449619fc7846d3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.353885 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8097a6a160b249a9a4449619fc7846d3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.355840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.385640 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.387823 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.400656 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1330/2689] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:49.401593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.403100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.503358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8097a6a160b249a9a4449619fc7846d3', 'request_id': 'req-96ec7f25-e9c9-497b-b9e6-86605b237875'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.522445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b4702-40d4-4bf1-9464-d3868699bf84 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.608924 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.611521 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.613177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.613637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.616530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8097a6a160b249a9a4449619fc7846d3', 'request_id': 'req-96ec7f25-e9c9-497b-b9e6-86605b237875'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.617962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.622835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8097a6a160b249a9a4449619fc7846d3', 'request_id': 'req-96ec7f25-e9c9-497b-b9e6-86605b237875'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.657290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] The token cache is being invalidate because project 8097a6a160b249a9a4449619fc7846d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:49.658357 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.659308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-96ec7f25-e9c9-497b-b9e6-86605b237875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.661503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1360/2690] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:49 2022] DELETE /identity/v3/projects/8097a6a160b249a9a4449619fc7846d3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:49.666280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5dead-698d-4dd4-a883-d8e8d7ab041b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.666783 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5dead-698d-4dd4-a883-d8e8d7ab041b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.672154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5dead-698d-4dd4-a883-d8e8d7ab041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.696394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-5df5dead-698d-4dd4-a883-d8e8d7ab041b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:49.698062 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-5df5dead-698d-4dd4-a883-d8e8d7ab041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.700829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.701146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.712341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1331/2691] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:49.788714 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.790232 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.794514 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1361/2692] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:49.810124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc10d-f757-41c4-9b8b-8d8335503484 service nova] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.814124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.815118 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.815409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.815707 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] PATH_INFO: `/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.816912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.817918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28dcc4cc96d4be9879b89fc2c7a3224)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.818348 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.818764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.819878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.839939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:49.867797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:49.867797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1362/2693] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:49.870889 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.881071 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e85ab-0380-4914-9c24-f329a65df70e None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.886165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.886838 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.887124 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.887403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.888187 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:49.888597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.890649 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.905107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1363/2694] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 13:16:49.910028 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:49.927513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae5a2-3a46-4ddc-808d-08807ce8ec22 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:49.933523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:49.934345 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:49.934702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:49.935050 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:49.936751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:49.938636 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:49.979136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28dcc4cc96d4be9879b89fc2c7a3224', 'request_id': 'req-f128f4d0-0af9-4962-a007-3734d6eeca4c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:49.990918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28dcc4cc96d4be9879b89fc2c7a3224', 'request_id': 'req-f128f4d0-0af9-4962-a007-3734d6eeca4c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.050101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1364/2695] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:49 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:50.054220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.068219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28dcc4cc96d4be9879b89fc2c7a3224', 'request_id': 'req-f128f4d0-0af9-4962-a007-3734d6eeca4c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.087464 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] The token cache is being invalidate because project e28dcc4cc96d4be9879b89fc2c7a3224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:50.087787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.088482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f128f4d0-0af9-4962-a007-3734d6eeca4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.090622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1332/2696] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:49 2022] DELETE /identity/v3/projects/e28dcc4cc96d4be9879b89fc2c7a3224 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:50.097351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2db85-aec5-4929-9316-1abb4b2f220e None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.097997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2db85-aec5-4929-9316-1abb4b2f220e None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.098470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2db85-aec5-4929-9316-1abb4b2f220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.140613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-58a2db85-aec5-4929-9316-1abb4b2f220e None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:50.141917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-58a2db85-aec5-4929-9316-1abb4b2f220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.177108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8548d-e305-44b2-b79a-319e1b5fd6e5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.181849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.182527 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.182809 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.183128 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.183863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.186049 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.218267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1333/2697] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:50.227635 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.227935 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.228226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.246447 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:50.247706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.256702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1334/2698] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:50.268495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.268495 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.275504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cf002-593a-49c4-87e5-0597c1549104 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.281014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1365/2699] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:50.281014 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.281628 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.282503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.282784 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.283246 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] PATH_INFO: `/v3/projects/91e063868082477ebf83ebcdcc3e05ed` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.284490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e063868082477ebf83ebcdcc3e05ed)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.288774 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.296396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d8e5-b5e6-4523-bb77-833b4f99af62 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.300437 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.301171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.302205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.302551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.303467 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:50.303815 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.305414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.319604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1366/2700] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:50.320660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.322366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.334879 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd2c-3a79-4f6a-a289-addba08cdf7b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.339759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.340395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.340685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.340966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.341687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.343374 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.354156 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1367/2701] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:50.355199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.365466 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a797db-e245-4663-a0bf-caecdb98257c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.370342 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.371002 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.371288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.371595 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.372286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.374191 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.419429 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e063868082477ebf83ebcdcc3e05ed', 'request_id': 'req-e0790956-195c-42d3-abdb-0ca1ec262817'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.426125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e063868082477ebf83ebcdcc3e05ed', 'request_id': 'req-e0790956-195c-42d3-abdb-0ca1ec262817'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.497729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1368/2702] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:50.498712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.517776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e063868082477ebf83ebcdcc3e05ed', 'request_id': 'req-e0790956-195c-42d3-abdb-0ca1ec262817'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.529905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] The token cache is being invalidate because project 91e063868082477ebf83ebcdcc3e05ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:50.530208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.530884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.532507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1335/2703] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:50 2022] DELETE /identity/v3/projects/91e063868082477ebf83ebcdcc3e05ed => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:50.533313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.534623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.618003 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7721cb-5723-449b-a965-0267eab70038 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.624778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0790956-195c-42d3-abdb-0ca1ec262817 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.625089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.625769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.626240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.626547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.628167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.630228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.632424 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.633289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.633582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.633867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.634569 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.636550 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.642589 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1369/2704] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:50.643765 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.647678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.662251 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d07c2d-441e-4171-ac9d-e2ad3b87a072 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.665922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.666945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.667244 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.667557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] PATH_INFO: `/v3/users/eb266e95628d4dcd92a4278283ef6cd0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.668832 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb266e95628d4dcd92a4278283ef6cd0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.670844 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.742897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1336/2705] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:50.743225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.747948 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.765831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f8e0-870e-4969-9022-142d84dc5af7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.774878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.775367 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.775590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.775879 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] PATH_INFO: `/v3/projects/edb552c78a394efd8bc87579dc46151c/users/ac59fb7b82ac4527a15e5ffede8917bf/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.794930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:50.796989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb552c78a394efd8bc87579dc46151c, user_id=ac59fb7b82ac4527a15e5ffede8917bf, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.801304 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.830603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb266e95628d4dcd92a4278283ef6cd0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.831291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb266e95628d4dcd92a4278283ef6cd0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.860926 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1337/2706] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:50 2022] PUT /identity/v3/projects/edb552c78a394efd8bc87579dc46151c/users/ac59fb7b82ac4527a15e5ffede8917bf/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:50.862005 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:50.864885 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:50.880768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:50.903300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb266e95628d4dcd92a4278283ef6cd0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.940100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb266e95628d4dcd92a4278283ef6cd0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.970016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a3bf-e437-4e97-afcb-53a17cf7622d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:50.973945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-390e3322-04f3-452e-81b5-0b569b2d965e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb266e95628d4dcd92a4278283ef6cd0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:50.976129 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:50.976878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.977268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.977638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.978415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:50.980154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:50.981109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1370/2707] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:50 2022] DELETE /identity/v3/users/eb266e95628d4dcd92a4278283ef6cd0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:50.986087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:50.986395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:50.986681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:50.996488 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1338/2708] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:51.001227 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.019776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380287e-0538-44c0-8ab9-98e40a6e5102 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.029508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] MFA Rules not processed for user `ac59fb7b82ac4527a15e5ffede8917bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:51.031041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:51.103939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.104651 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.104940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.105221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.105992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.107676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.110551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1371/2709] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:51.115928 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.117199 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:51.120652 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1339/2710] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:51.126364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.132365 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3245d2-3c0b-4177-a9b3-6083bd3c4ca4 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.137740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d507-0549-41ef-8f0a-6aca5fb29c34 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.137962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.138639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.138926 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.139206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.140069 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.141986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.142525 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.143407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.143772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.144053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] PATH_INFO: `/v3/projects/d5afc780118047fc8dcf1771dc62244a/users/f310c5abc9c0428186d80f06b66ddb18/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.159701 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5afc780118047fc8dcf1771dc62244a, user_id=f310c5abc9c0428186d80f06b66ddb18, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.162956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6026b-3219-4e91-8002-264c764b56f6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.234665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1372/2711] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:51.236849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.259576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1340/2712] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:51 2022] PUT /identity/v3/projects/d5afc780118047fc8dcf1771dc62244a/users/f310c5abc9c0428186d80f06b66ddb18/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:51.268218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.268785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.269259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.298836 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:51.310578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] MFA Rules not processed for user `f310c5abc9c0428186d80f06b66ddb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:51.312843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:51.338632 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff213ae8-9c6e-40cc-88e0-fc370f521481 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.399798 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1341/2713] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:51.404658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.423681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.424454 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.424776 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.425052 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.425752 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.428410 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.478538 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a004ab-b9ea-46ff-82c9-e513107fe19d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.483712 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.484499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.484853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.485067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.485825 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.487783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.521190 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1373/2714] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:51.522522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.529598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:51.547063 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfc78-cfc3-4921-b437-5f2456221a04 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.553399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.554280 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.554574 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.554957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] PATH_INFO: `/v3/projects/b0111298113847259cdbe304f699dbe9` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.556250 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0111298113847259cdbe304f699dbe9)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.558333 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.574509 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1342/2715] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:51.575565 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.648319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ad12e-4aef-4f3d-a5fc-48cb0821ca3a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.653324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.654024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.654442 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.654739 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.655503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.657139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.668331 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1343/2716] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:51.672202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.683182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b538-554b-47a6-aedf-fc4629e3eb37 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.688155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.688812 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.689102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.689376 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.690057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.692041 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.714851 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0111298113847259cdbe304f699dbe9', 'request_id': 'req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:51.789115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1344/2717] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:51.789838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.800609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d3df-f54f-45e3-8fcd-0ad8005dcea4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.816578 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0111298113847259cdbe304f699dbe9', 'request_id': 'req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:51.825418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0111298113847259cdbe304f699dbe9', 'request_id': 'req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:51.840235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] The token cache is being invalidate because project b0111298113847259cdbe304f699dbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:51.841064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:51.842084 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:51.844515 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1374/2718] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:51 2022] DELETE /identity/v3/projects/b0111298113847259cdbe304f699dbe9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:51.845545 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.849738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:51.872962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.874142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.874438 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.874717 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] PATH_INFO: `/v3/projects/bd7476890fa14f5399e16fc713881341/users/bb52f06843bf41dc96adea0dfc6cf72d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.893718 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7476890fa14f5399e16fc713881341, user_id=bb52f06843bf41dc96adea0dfc6cf72d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.898336 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.940853 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03002d-0bd7-4f2e-8ef3-1f79b7352595 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:51.946074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:51.950402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.950402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.950402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.950402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:51.950402 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46edc4-9c9d-4aac-9685-110548c20e0b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:51.961160 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1375/2719] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:51.962327 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:51.962622 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:51.963064 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:51.981763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1345/2720] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:51 2022] PUT /identity/v3/projects/bd7476890fa14f5399e16fc713881341/users/bb52f06843bf41dc96adea0dfc6cf72d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:51.985588 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:51.986787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:51.989547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.099884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1376/2721] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:52.099884 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.101023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2f587-d311-4123-8ab1-5929d1ee454f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.101842 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.107400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.107400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.107400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.107400 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] PATH_INFO: `/v3/projects/0e5cd49e88e849e78d406cf3d820cf40/users/ed09838e028f4d50b42d7abebed8aaff/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.119072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee78c-7377-4304-9558-70b9cf5ce485 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.128959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.129117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.129396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.129797 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.130488 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.132150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4f84-78ca-4c85-843a-05b35e349845 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.146493 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5cd49e88e849e78d406cf3d820cf40, user_id=ed09838e028f4d50b42d7abebed8aaff, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.149943 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.159796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1377/2722] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:52.164913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.169379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.169379 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.198683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:52.200134 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.220380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1378/2723] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:52.221444 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.227426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1346/2724] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:51 2022] PUT /identity/v3/projects/0e5cd49e88e849e78d406cf3d820cf40/users/ed09838e028f4d50b42d7abebed8aaff/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:52.227426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.240395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9109-a05e-4d03-95b8-ae373dbfb0bb None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.346637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2dbcb-443c-4e7f-89bf-3b23899a488d admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.353004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.355022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.355621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.355867 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.356184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.356788 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:52.357417 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.359831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.360000 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.360323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.370409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] PATH_INFO: `/v3/projects/bd7476890fa14f5399e16fc713881341/users/bb52f06843bf41dc96adea0dfc6cf72d/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.370409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7476890fa14f5399e16fc713881341, user_id=bb52f06843bf41dc96adea0dfc6cf72d, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.370409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.383216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1347/2725] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:52.383216 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.405232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1379/2726] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:52 2022] PUT /identity/v3/projects/bd7476890fa14f5399e16fc713881341/users/bb52f06843bf41dc96adea0dfc6cf72d/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:52.405232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.405570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643994c-601e-4f61-843c-9758797cc6e1 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.479019 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.479818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.480078 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.480402 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.481184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.483018 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e3b9d-0b75-413a-96f3-5680b5a33f43 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.494448 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1348/2727] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:52.495688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feb82-0872-467e-9019-41443c61f692 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.495990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feb82-0872-467e-9019-41443c61f692 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.496269 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feb82-0872-467e-9019-41443c61f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.511409 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40666847-36c3-44f8-a829-aa7a04603dd5 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.519147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.519767 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.521998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.522460 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.523277 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.526208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.526479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-880feb82-0872-467e-9019-41443c61f692 None None] MFA Rules not processed for user `bb52f06843bf41dc96adea0dfc6cf72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:52.527773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-880feb82-0872-467e-9019-41443c61f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.668523 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1349/2728] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:52.685978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880feb82-0872-467e-9019-41443c61f692 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.685978 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880feb82-0872-467e-9019-41443c61f692 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.688741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.689646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.690638 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.690921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] PATH_INFO: `/v3/projects/0e5cd49e88e849e78d406cf3d820cf40/users/ed09838e028f4d50b42d7abebed8aaff/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.693609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5cd49e88e849e78d406cf3d820cf40, user_id=ed09838e028f4d50b42d7abebed8aaff, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.696306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.708117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1350/2729] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:52 2022] PUT /identity/v3/projects/0e5cd49e88e849e78d406cf3d820cf40/users/ed09838e028f4d50b42d7abebed8aaff/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:52.709079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:52.715622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.786451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63af7b4-6db4-412e-8dbd-e383ddae5fc3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:52.790267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:52.790959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.791244 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.791519 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.860857 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:52.862256 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9190-fadc-4d90-aab1-275cb757a7d9 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:52.874079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1351/2730] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:52.876648 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:52.877137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:52.877587 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:52.937557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] MFA Rules not processed for user `ed09838e028f4d50b42d7abebed8aaff`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:52.937557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:52.972344 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1380/2731] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:52 2022] POST /identity/v3/projects => generated 361 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:52.985895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.034284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1352/2732] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:53.036600 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.073378 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:53.115953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6b3e0-57e1-46fc-80f8-eeea0e29a03e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.128135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.130457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.130457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.130457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] PATH_INFO: `/v3/users/ac59fb7b82ac4527a15e5ffede8917bf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.136418 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3aeaa-9684-4fb1-9f84-65c420931c8d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.136566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac59fb7b82ac4527a15e5ffede8917bf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.136566 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.141549 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.142383 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.143498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.143498 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.143947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.148866 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.271504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1353/2733] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:53 2022] POST /identity/v3/users => generated 281 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:53.271504 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.337957 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9f45-e4b8-4952-b084-90c88fb6854c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.342068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.342880 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.343167 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.343441 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.376814 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac59fb7b82ac4527a15e5ffede8917bf'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:53.380522 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac59fb7b82ac4527a15e5ffede8917bf'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:53.434124 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.436028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.449164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1354/2734] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:53.450192 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.463143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd80bc-ccdc-4952-9c90-af63cedad721 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.468498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac59fb7b82ac4527a15e5ffede8917bf'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:53.471469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.471469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.471469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.471469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.472095 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.473071 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa15dd-5c2b-4969-81bd-3c3ad09b55db admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.491582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1355/2735] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:53.493444 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d96f-9862-429b-a1fa-fa70aa56cd8d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.493738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d96f-9862-429b-a1fa-fa70aa56cd8d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.496980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d96f-9862-429b-a1fa-fa70aa56cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.497659 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac59fb7b82ac4527a15e5ffede8917bf'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:53.498161 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:53.511941 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac59fb7b82ac4527a15e5ffede8917bf'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:53.524985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-5185d96f-9862-429b-a1fa-fa70aa56cd8d None None] MFA Rules not processed for user `eaa2b82129ac4f8796fdd57cad8e0bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:53.526453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5185d96f-9862-429b-a1fa-fa70aa56cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:53.528647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1381/2736] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:52 2022] DELETE /identity/v3/users/ac59fb7b82ac4527a15e5ffede8917bf => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:53.534666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.534666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:53.607676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1356/2737] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:53.610870 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.611166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.613728 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.622257 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51f97-6bf1-4218-88d6-7e92d4776665 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.627704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.628457 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.628811 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.629161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.629993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.631839 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.652641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1382/2738] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:53.652641 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.660907 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:53.662515 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:53.671585 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463673ec-4625-4e39-b538-48586fd5aad1 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.682154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1357/2739] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:53.688024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.696401 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.696779 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.697140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] PATH_INFO: `/v3/projects/fe7b5f803b8647dcb5e001c4dd82d2e8/users/a112a36356234053a72475f69a3b848c/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.707137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:53.709546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:53.731768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7b5f803b8647dcb5e001c4dd82d2e8, user_id=a112a36356234053a72475f69a3b848c, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.734751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd40a5-a23c-4e7f-a880-f2377f707dca admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.806877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd619926-788f-4203-a59f-89cc0e7871b7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:53.812198 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:53.812863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.813150 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.813455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.824533 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:53.825977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6f66b-caa2-4240-bf4c-349c6e5cdba2 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:53.838936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1358/2740] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:53.864541 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1383/2741] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:53 2022] PUT /identity/v3/projects/fe7b5f803b8647dcb5e001c4dd82d2e8/users/a112a36356234053a72475f69a3b848c/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:53.866259 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:53.866552 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:53.867166 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:53.929597 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] MFA Rules not processed for user `a112a36356234053a72475f69a3b848c`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:53.932581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:54.046125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1359/2742] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:16:54.311618 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:54.312095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:54.312396 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:54.321405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:54.322834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:54.331291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] MFA Rules not processed for user `bd78c278513540ecadfc1a0f90b9ab16`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:54.333115 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:54.380188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91fda4-df59-4aaf-ad84-67f9cdf63a36 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:54.383771 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:54.384419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:54.384706 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:54.384985 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:54.389235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1384/2743] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:54.401093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:54.401093 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:54.403458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:54.405174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:54.437556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1360/2744] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:54.458590 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:54.481685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:54.503230 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf11370-b57f-43cc-a721-383ac72b0e64 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:54.512774 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:54.513939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:54.516945 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:54.527395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] PATH_INFO: `/v3/projects/edb552c78a394efd8bc87579dc46151c` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:54.530072 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb552c78a394efd8bc87579dc46151c)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:54.538420 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:54.607316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba1a-4af7-4d34-bd14-b7d07763a4d2 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:54.614067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:54.615285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:54.615844 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:54.617305 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] PATH_INFO: `/v3/users/a112a36356234053a72475f69a3b848c` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:54.621194 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a112a36356234053a72475f69a3b848c)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:54.623445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:54.675955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb552c78a394efd8bc87579dc46151c', 'request_id': 'req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.788690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb552c78a394efd8bc87579dc46151c', 'request_id': 'req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.798637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb552c78a394efd8bc87579dc46151c', 'request_id': 'req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.817718 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] The token cache is being invalidate because project edb552c78a394efd8bc87579dc46151c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:54.818254 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.820253 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.827859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1385/2745] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:54 2022] DELETE /identity/v3/projects/edb552c78a394efd8bc87579dc46151c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:54.827859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:54.833247 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:54.872425 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a112a36356234053a72475f69a3b848c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.876284 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a112a36356234053a72475f69a3b848c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.894352 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a112a36356234053a72475f69a3b848c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.920499 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a112a36356234053a72475f69a3b848c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:54.966269 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd08f7-53a7-4640-a8bd-4d83ff109e22 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:54.981664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:54.983184 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:54.983882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:54.984920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] PATH_INFO: `/v3/users/f310c5abc9c0428186d80f06b66ddb18` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:54.986664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f310c5abc9c0428186d80f06b66ddb18)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:54.990656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:55.000820 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a112a36356234053a72475f69a3b848c'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.016132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1361/2746] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:54 2022] DELETE /identity/v3/users/a112a36356234053a72475f69a3b848c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:55.017261 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:55.025193 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.112946 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6627df-12d6-4aa2-94fa-248dabff53d7 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:55.121286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:55.123636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:55.123636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:55.123636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] PATH_INFO: `/v3/users/bb52f06843bf41dc96adea0dfc6cf72d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:55.124634 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb52f06843bf41dc96adea0dfc6cf72d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:55.127962 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:55.216537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f310c5abc9c0428186d80f06b66ddb18'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.217319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f310c5abc9c0428186d80f06b66ddb18'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.302264 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f310c5abc9c0428186d80f06b66ddb18'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.318886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f310c5abc9c0428186d80f06b66ddb18'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.331599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-d197c603-ea00-4fb8-9f9a-18f9ed283e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f310c5abc9c0428186d80f06b66ddb18'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.345820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1386/2747] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:54 2022] DELETE /identity/v3/users/f310c5abc9c0428186d80f06b66ddb18 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:55.345820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb3da-f32b-4b55-8d6c-3a452f2ba4b9 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:55.345820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb3da-f32b-4b55-8d6c-3a452f2ba4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:55.345820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eeb3da-f32b-4b55-8d6c-3a452f2ba4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:55.372784 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-a0eeb3da-f32b-4b55-8d6c-3a452f2ba4b9 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:55.374604 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-a0eeb3da-f32b-4b55-8d6c-3a452f2ba4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.380271 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb52f06843bf41dc96adea0dfc6cf72d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.382719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb52f06843bf41dc96adea0dfc6cf72d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.393986 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:55.408001 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb52f06843bf41dc96adea0dfc6cf72d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.429079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb52f06843bf41dc96adea0dfc6cf72d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.477541 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1387/2748] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:55.483654 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:55.484455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:55.484859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:55.487399 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb52f06843bf41dc96adea0dfc6cf72d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:55.501483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1362/2749] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:55 2022] DELETE /identity/v3/users/bb52f06843bf41dc96adea0dfc6cf72d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:55.501483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:55.501483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.515001 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:55.517755 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.596625 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ed8a-2c8d-40bd-b2ea-df729887a68f admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:55.601703 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:55.602462 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:55.602984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:55.603160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:55.605323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.628924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1388/2750] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:55.638599 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:55.640325 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:55.666505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32ae2-e9d1-4c4c-a865-a07ac50c5295 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:55.671161 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:55.671973 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:55.672303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:55.672672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:55.683773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:55.685306 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:55.696859 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1389/2751] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:55.727446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:55.729973 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:55.741199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1363/2752] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:56.279022 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:56.314408 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:56.315302 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:56.315931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:56.320611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:56.336764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6aca-d8b0-4886-bcf4-6f31a9b9c80a service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:56.343426 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:56.345150 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:56.346114 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:56.347237 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] PATH_INFO: `/v3/projects/bd7476890fa14f5399e16fc713881341` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:56.349290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7476890fa14f5399e16fc713881341)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:56.354436 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:56.354925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8a62-974b-4c98-8f25-ba6ac118f7ea service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:56.360375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:56.361189 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:56.361475 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:56.361751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] PATH_INFO: `/v3/projects/d5afc780118047fc8dcf1771dc62244a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:56.363453 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5afc780118047fc8dcf1771dc62244a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:56.366690 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:56.482959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7476890fa14f5399e16fc713881341', 'request_id': 'req-c56f5927-da28-44a1-8c0f-5b9d176a1262'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.527848 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5afc780118047fc8dcf1771dc62244a', 'request_id': 'req-8c683cab-1080-4060-b0f5-5f91d94e07b0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.533347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5afc780118047fc8dcf1771dc62244a', 'request_id': 'req-8c683cab-1080-4060-b0f5-5f91d94e07b0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.605796 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7476890fa14f5399e16fc713881341', 'request_id': 'req-c56f5927-da28-44a1-8c0f-5b9d176a1262'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.612764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7476890fa14f5399e16fc713881341', 'request_id': 'req-c56f5927-da28-44a1-8c0f-5b9d176a1262'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.627887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] The token cache is being invalidate because project bd7476890fa14f5399e16fc713881341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:56.628404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.629314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.631539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1390/2753] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:56 2022] DELETE /identity/v3/projects/bd7476890fa14f5399e16fc713881341 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:56.634882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:56.634882 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:56.713317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5afc780118047fc8dcf1771dc62244a', 'request_id': 'req-8c683cab-1080-4060-b0f5-5f91d94e07b0'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.727057 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] The token cache is being invalidate because project d5afc780118047fc8dcf1771dc62244a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:56.727377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.728061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-8c683cab-1080-4060-b0f5-5f91d94e07b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.730026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1364/2754] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:56 2022] DELETE /identity/v3/projects/d5afc780118047fc8dcf1771dc62244a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:56.731267 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:56.731570 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:56.732015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:56.736058 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5927-da28-44a1-8c0f-5b9d176a1262 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:56.755747 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:56.757067 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:56.800687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:56.802262 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:56.802556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:56.802837 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] PATH_INFO: `/v3/projects/fe7b5f803b8647dcb5e001c4dd82d2e8` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:56.804095 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7b5f803b8647dcb5e001c4dd82d2e8)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:56.806405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:56.835955 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1365/2755] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:56.840457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:56.842052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:56.855223 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb14b-6eda-4f91-bf0b-422ea2a24be4 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:56.861207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:56.863348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:56.863348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:56.863348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] PATH_INFO: `/v3/users/ed09838e028f4d50b42d7abebed8aaff` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:56.865037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed09838e028f4d50b42d7abebed8aaff)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:56.867296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:56.931248 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7b5f803b8647dcb5e001c4dd82d2e8', 'request_id': 'req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:56.998927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7b5f803b8647dcb5e001c4dd82d2e8', 'request_id': 'req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.005903 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7b5f803b8647dcb5e001c4dd82d2e8', 'request_id': 'req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.017256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] The token cache is being invalidate because project fe7b5f803b8647dcb5e001c4dd82d2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:57.017547 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.018214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-9b24e9f2-1f1e-4b29-86c2-0ed64342f4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.019803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1391/2756] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:56 2022] DELETE /identity/v3/projects/fe7b5f803b8647dcb5e001c4dd82d2e8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:57.021400 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f900a1-8438-4c30-bec3-d15ae7a56af8 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.021556 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f900a1-8438-4c30-bec3-d15ae7a56af8 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.021758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f900a1-8438-4c30-bec3-d15ae7a56af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.042513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b9f900a1-8438-4c30-bec3-d15ae7a56af8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:57.044703 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b9f900a1-8438-4c30-bec3-d15ae7a56af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:57.070013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed09838e028f4d50b42d7abebed8aaff'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.070680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed09838e028f4d50b42d7abebed8aaff'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.077649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed09838e028f4d50b42d7abebed8aaff'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.091864 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed09838e028f4d50b42d7abebed8aaff'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.101803 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:57.109679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1392/2757] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:57.110931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.111220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.111544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.130504 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:57.131785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:57.147829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1393/2758] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:57.147829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.151086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6626-c9ff-40b4-8162-6d02807a91ce None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.158340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.158340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.158340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.158340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.158666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:57.158666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.160066 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bf58-927b-4f2b-99a8-63ef783db678 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.175861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1394/2759] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:57.177724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a196-5796-4bba-a170-714761818fb6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.177724 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a196-5796-4bba-a170-714761818fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.177980 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a196-5796-4bba-a170-714761818fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.179877 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed09838e028f4d50b42d7abebed8aaff'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.187228 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1366/2760] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:56 2022] DELETE /identity/v3/users/ed09838e028f4d50b42d7abebed8aaff => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:57.191101 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.192778 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:57.202597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3385a196-5796-4bba-a170-714761818fb6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:57.202597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3385a196-5796-4bba-a170-714761818fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:57.290656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1395/2761] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:57.291995 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a196-5796-4bba-a170-714761818fb6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.301332 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c839-3b03-4500-9091-a4e4558a4e35 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.306473 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a196-5796-4bba-a170-714761818fb6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.306752 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.307138 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.307421 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.307917 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.308415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.309352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.310211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.310420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.310791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.311208 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.312174 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:57.312526 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.315171 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.335319 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1396/2762] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:57.336560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.346678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906ba95-266f-49b6-ba59-0fea796fd057 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.352273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.353398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.353398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.353704 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.354332 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.356361 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.418359 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1367/2763] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:57.422483 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.484802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1397/2764] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:57.489953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.492942 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153e7c3-d4b5-46bf-abaf-8f8fdb4a1c40 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.581901 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.583585 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.584153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.584544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.585322 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.587611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.605892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9680be-19fe-4047-9d00-c81df2388442 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.614105 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.615077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.615366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.615687 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.616429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.618369 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.699723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1368/2765] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:57.700918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.711510 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489665-5ea5-46c2-9c08-8c29f3bf9af4 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.716182 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.717100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.717435 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.717809 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.718560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.720723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.735398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1369/2766] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:57.738858 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1398/2767] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:57 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:57.739023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.739958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.747113 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13726-8484-4830-b4d3-1a2972be7a20 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.749781 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4625ee-7e08-48f6-8614-9c3a1b1bca20 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.752106 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.752756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.753046 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.753323 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.754087 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.755861 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.756516 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.756633 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.756802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.757220 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.757971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.759685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.774573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1370/2769] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:57.774812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1399/2769] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:57.775576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.776091 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.787100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493aadc-062e-4fb2-aba5-e835f6ebf7a4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.787654 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4164-efd8-4822-a6f8-d2e1fb6c0afa admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.792761 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.793781 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.793936 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.794178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.794822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.795273 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.795741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.797722 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.799758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] PATH_INFO: `/v3/projects/6a392be77a2a49cfb1543c355395a06d/users/b31e952e28b240f581994efde985b966/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.800014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.810738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:57.816766 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1371/2770] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:57.818175 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.820003 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:57.824012 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a392be77a2a49cfb1543c355395a06d, user_id=b31e952e28b240f581994efde985b966, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.827218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.833289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ae31-3ff8-4c72-941d-4feed28d3d3c admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:57.838160 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:57.839052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:57.839364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:57.839683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] PATH_INFO: `/v3/projects/0e5cd49e88e849e78d406cf3d820cf40` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:57.840900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5cd49e88e849e78d406cf3d820cf40)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:57.842905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:57.879435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1400/2771] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:57 2022] PUT /identity/v3/projects/6a392be77a2a49cfb1543c355395a06d/users/b31e952e28b240f581994efde985b966/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:16:57.893597 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:57.895548 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:57.946313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5cd49e88e849e78d406cf3d820cf40', 'request_id': 'req-7be4bd4e-9d4b-43cc-8120-1b8e27257309'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.955109 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5cd49e88e849e78d406cf3d820cf40', 'request_id': 'req-7be4bd4e-9d4b-43cc-8120-1b8e27257309'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:57.972685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45c80b-159f-41e0-aa69-3fcec3062e33 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.030112 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.030997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.031380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.031582 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] PATH_INFO: `/v3/projects/2dbb7192ee02406a959af9cc4c2577a2/users/34e95873c90645b59bd6225c15118847/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.046608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dbb7192ee02406a959af9cc4c2577a2, user_id=34e95873c90645b59bd6225c15118847, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.049598 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479128-dfc4-4fe1-80c4-6da10ce13ff9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.061306 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5cd49e88e849e78d406cf3d820cf40', 'request_id': 'req-7be4bd4e-9d4b-43cc-8120-1b8e27257309'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.073708 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] The token cache is being invalidate because project 0e5cd49e88e849e78d406cf3d820cf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:16:58.073989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.074679 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-7be4bd4e-9d4b-43cc-8120-1b8e27257309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.076386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1372/2772] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:57 2022] DELETE /identity/v3/projects/0e5cd49e88e849e78d406cf3d820cf40 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:58.077765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4d73-a148-4d3e-8e49-44ce6c70920d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.078064 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4d73-a148-4d3e-8e49-44ce6c70920d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.078343 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4d73-a148-4d3e-8e49-44ce6c70920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.109693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-88ae4d73-a148-4d3e-8e49-44ce6c70920d None None] MFA Rules not processed for user `b31e952e28b240f581994efde985b966`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:58.111355 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-88ae4d73-a148-4d3e-8e49-44ce6c70920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.147370 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1401/2773] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:57 2022] PUT /identity/v3/projects/2dbb7192ee02406a959af9cc4c2577a2/users/34e95873c90645b59bd6225c15118847/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:58.148736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.149032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.149313 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.174559 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:58.175505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.181266 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1373/2774] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:58.186846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b98a-cb68-4e01-a9ec-1233b03333d8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.186846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b98a-cb68-4e01-a9ec-1233b03333d8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.186846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b98a-cb68-4e01-a9ec-1233b03333d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.213776 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-27b5b98a-cb68-4e01-a9ec-1233b03333d8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:58.215236 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-27b5b98a-cb68-4e01-a9ec-1233b03333d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.253031 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1402/2775] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:58.255666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.256243 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.310546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1374/2776] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:58.326672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38605ceb-0aca-4c6b-9ae9-e6ad4dd7874c None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.330737 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.334857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.334857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.334857 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.335188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.335188 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.336220 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.378128 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:58.380299 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.406702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1375/2777] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:58.408348 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:58.410136 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.412980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.413135 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.414576 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.427322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1403/2778] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:58.433386 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.445720 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90967a-c44a-45d7-aa00-e9cdecdaf3b3 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.451617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.451617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.451931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.452216 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.453205 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:16:58.453518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.455577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.471303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1404/2779] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:16:58.471303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.471303 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:58.485339 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd9ee3-9fe6-4b9c-a192-5e0957c948dc admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.491645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.492310 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0fd3-7a46-4e9e-8c3c-99f8dde57ac8 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.495138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.495138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.495138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] PATH_INFO: `/v3/users/b31e952e28b240f581994efde985b966` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.495138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31e952e28b240f581994efde985b966)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.496620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.497683 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.498397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.498699 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.499248 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.512741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.518921 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.532613 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1376/2780] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:16:58.533589 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.544566 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31487b-b4c7-4d6f-b213-72dea1e11e6f service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.557617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.558394 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.558685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.558970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.560353 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.562105 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.757083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1377/2781] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:58.761576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:58.805289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31e952e28b240f581994efde985b966'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.806004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31e952e28b240f581994efde985b966'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.837040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28da895-2afb-4fb9-9e60-764711603350 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:58.842021 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:58.842710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.842999 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.843280 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.844086 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:58.846013 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:58.878820 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31e952e28b240f581994efde985b966'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.888608 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:58.907144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31e952e28b240f581994efde985b966'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.914448 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-65db219d-6e85-4f61-ba3e-67b76e3afa76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31e952e28b240f581994efde985b966'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:16:58.924302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1405/2782] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:16:58 2022] DELETE /identity/v3/users/b31e952e28b240f581994efde985b966 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:58.927993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:58.928573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:58.928893 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:58.960627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:58.963758 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:59.008934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1378/2783] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:59.009860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.011941 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:59.026564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2f3c-02a8-4cc8-85d5-7e7cdb92d8d8 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.063773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1406/2784] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:59.074304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.075924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:59.096230 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.097033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.097382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.097726 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.099389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.102691 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.120919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1379/2785] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:16:59.121960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.133137 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d8901-f905-4dcd-bca6-4c633a86fe91 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.142765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.142765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.142765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.142765 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.143231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.143231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.158155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1380/2786] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:16:59.159215 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.175053 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef1a54-bc39-411c-b494-6481f0e0e058 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.175208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880013c4-4244-4b4e-9b03-7677bac3deb6 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.183409 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.184591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.184947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.185288 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] PATH_INFO: `/v3/projects/49ac4327336944bdbf10d29bb6f4c424/users/09f3f39bf79746f89b281ab6422c8670/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.189551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.190234 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.190588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.190880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.198126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:59.203789 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.209698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8a65-721d-44ea-81fc-6e1aee0ffdaa service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.209834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ac4327336944bdbf10d29bb6f4c424, user_id=09f3f39bf79746f89b281ab6422c8670, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.210554 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.216823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1407/2787] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:16:59.338974 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1381/2788] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:16:59 2022] PUT /identity/v3/projects/49ac4327336944bdbf10d29bb6f4c424/users/09f3f39bf79746f89b281ab6422c8670/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:16:59.340746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.341048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.341312 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.383757 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] MFA Rules not processed for user `09f3f39bf79746f89b281ab6422c8670`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:16:59.385147 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:59.517825 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1408/2789] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:16:59.522176 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.629443 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fc89d-dd82-4558-a385-63008b2b4c22 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.640047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.645760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.645760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.645760 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] PATH_INFO: `/v3/projects` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.646237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.648052 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.759598 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1382/2790] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:16:59 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:16:59.763950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.790407 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593359-7b6a-44a9-a178-058966866e96 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.882480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:16:59.883304 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:16:59.883867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:16:59.884222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:16:59.888352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:16:59.888352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:16:59.970676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:16:59.977622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:16:59.991601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1409/2791] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:16:59 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:16:59.994456 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529521-52a3-4539-94c4-c1d1fd98554e admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:16:59.997217 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.016010 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064387f-ddaf-46b3-addb-f01dc3b39394 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.026225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.028107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.028798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.029081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.029427 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.030125 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.030405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.031548 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.032980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] PATH_INFO: `/v3/projects/6a392be77a2a49cfb1543c355395a06d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.038630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a392be77a2a49cfb1543c355395a06d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.039045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.046157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.057432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1410/2792] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:17:00.061739 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.074138 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb684c-ffae-4732-aa1b-dd6b034f55fc admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.081265 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.082168 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.083081 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.083328 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] PATH_INFO: `/v3/projects/54fc7ccac78747a296d852e5a62433ad/users/7f76276271c045ce93b52e1987d80d85/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.109577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc7ccac78747a296d852e5a62433ad, user_id=7f76276271c045ce93b52e1987d80d85, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.112165 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.199628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1411/2793] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:17:00 2022] PUT /identity/v3/projects/54fc7ccac78747a296d852e5a62433ad/users/7f76276271c045ce93b52e1987d80d85/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:17:00.200683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.217617 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a392be77a2a49cfb1543c355395a06d', 'request_id': 'req-90708d6d-0d79-46e4-8378-5bab6fa699df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:00.228988 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a392be77a2a49cfb1543c355395a06d', 'request_id': 'req-90708d6d-0d79-46e4-8378-5bab6fa699df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:00.264619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:00.309923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237fca3-30f6-4d49-bcf7-b3cf0bee07c4 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.319773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a392be77a2a49cfb1543c355395a06d', 'request_id': 'req-90708d6d-0d79-46e4-8378-5bab6fa699df'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:00.324958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:00.345843 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] The token cache is being invalidate because project 6a392be77a2a49cfb1543c355395a06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:00.352250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:00.352250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-90708d6d-0d79-46e4-8378-5bab6fa699df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:00.352250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1383/2794] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:16:59 2022] DELETE /identity/v3/projects/6a392be77a2a49cfb1543c355395a06d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:00.352250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b171ad-b2d7-4afa-8a7d-9aa92de32d53 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.352250 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b171ad-b2d7-4afa-8a7d-9aa92de32d53 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.352674 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b171ad-b2d7-4afa-8a7d-9aa92de32d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.428392 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-10b171ad-b2d7-4afa-8a7d-9aa92de32d53 None None] MFA Rules not processed for user `34e95873c90645b59bd6225c15118847`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:00.429657 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-10b171ad-b2d7-4afa-8a7d-9aa92de32d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.440805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.441555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.449818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.449818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.449818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.449818 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75cb12-bd8e-4736-89ca-32ad9298eac9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.465616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1412/2795] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:17:00.467211 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43035-f077-418f-9561-9eab97735607 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.467786 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43035-f077-418f-9561-9eab97735607 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.468696 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43035-f077-418f-9561-9eab97735607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.494194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-3cb43035-f077-418f-9561-9eab97735607 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:00.496086 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3cb43035-f077-418f-9561-9eab97735607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.512531 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1413/2796] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:00.513523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43035-f077-418f-9561-9eab97735607 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.514961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3cb43035-f077-418f-9561-9eab97735607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.528418 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43035-f077-418f-9561-9eab97735607 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.533438 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.534331 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.534617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.534895 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] PATH_INFO: `/v3/projects/54fc7ccac78747a296d852e5a62433ad/users/7f76276271c045ce93b52e1987d80d85/roles/32e86bbc786f4bd585e514ac1b5b2694` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.537702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc7ccac78747a296d852e5a62433ad, user_id=7f76276271c045ce93b52e1987d80d85, role_id=32e86bbc786f4bd585e514ac1b5b2694)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.544594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.546015 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1384/2797] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:00.547489 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689b29-f739-41f0-bcbf-ddc8ed26372b None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.547838 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689b29-f739-41f0-bcbf-ddc8ed26372b None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.548120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689b29-f739-41f0-bcbf-ddc8ed26372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.555318 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1414/2798] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:17:00 2022] PUT /identity/v3/projects/54fc7ccac78747a296d852e5a62433ad/users/7f76276271c045ce93b52e1987d80d85/roles/32e86bbc786f4bd585e514ac1b5b2694 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:00.565863 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.569560 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.573047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-db689b29-f739-41f0-bcbf-ddc8ed26372b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:00.573047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-db689b29-f739-41f0-bcbf-ddc8ed26372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.675683 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476af89-0931-43dc-b967-8463ac1f14be admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.682036 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.682915 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.683343 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.683733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.703891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1385/2799] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:00.703891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.703891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.703891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.744905 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] MFA Rules not processed for user `7f76276271c045ce93b52e1987d80d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:00.746467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.778612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.783769 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.803294 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1415/2800] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:00.804417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.819177 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eb65c-ec99-4278-a93d-5743630dea95 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.825670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.826573 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.827297 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.827923 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.829206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:17:00.829934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.840998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.871372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1416/2801] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:17:00.876486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.889214 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023366f2-4639-458d-889e-e582b32c5290 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.896322 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.896997 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.897288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.897562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.898273 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:00.900480 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:00.905181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:00.930349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1386/2802] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:00.953263 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:00.957154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:00.959347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:00.980579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dc38-026d-4696-a36a-f230392d86b7 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:00.991079 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:00.991816 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:00.992156 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:00.992445 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:00.994673 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:01.010300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1417/2803] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:17:00 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:17:01.014131 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:01.122122 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb3d03-3280-437b-85c5-9de6cb5b1b04 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:01.127918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:01.128829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.129120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.130033 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.130979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.132968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.133878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.135887 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.149014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1387/2804] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:17:01.284537 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1418/2805] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:17:01 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:17:01.284775 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:01.298693 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284a62-1c1f-4315-b194-78ef77c80267 service cinder] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:01.305153 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:01.305939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.306229 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.306528 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.307268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.308923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.320997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1388/2806] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:17:01.325347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:01.337810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069422b-d256-43e0-ada4-14d0dab70a6c admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:01.342856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:01.343583 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.343878 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.344163 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.344909 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.346603 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de7f6-3346-4127-8971-d4b4a44201fa admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.360914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1419/2807] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:17:01.363303 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:01.376164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c25d32-dd7c-4545-bd9f-9f8efc9e0794 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:01.382576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:01.383357 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.383700 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.385770 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] PATH_INFO: `/v3/projects/b1b5736cf6a64f0ba8fc3e5ed99ba5f3/users/6878bc80434b494bbaeb67b9b3559abf/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.401632 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5736cf6a64f0ba8fc3e5ed99ba5f3, user_id=6878bc80434b494bbaeb67b9b3559abf, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.405982 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.485772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1389/2808] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:17:01 2022] PUT /identity/v3/projects/b1b5736cf6a64f0ba8fc3e5ed99ba5f3/users/6878bc80434b494bbaeb67b9b3559abf/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:17:01.497727 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5e89-bdc6-4a72-9331-4c01995a5108 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.498338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5e89-bdc6-4a72-9331-4c01995a5108 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.498810 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5e89-bdc6-4a72-9331-4c01995a5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.538120 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-adae5e89-bdc6-4a72-9331-4c01995a5108 None None] MFA Rules not processed for user `6878bc80434b494bbaeb67b9b3559abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:01.540881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-adae5e89-bdc6-4a72-9331-4c01995a5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:01.617500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1420/2809] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:01.630719 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:01.633062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:01.725325 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f897-890c-40e8-870f-212ea8653091 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:01.736620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74ba06aac5c41fb84b55297050305ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:01.737762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:01.738225 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:01.739846 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:01.747862 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:01.758897 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:01.760474 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:01.771253 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1390/2810] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:02.239947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:02.267352 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:02.792647 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c047-2e5d-4854-8d85-f5ef72ab51da None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:02.796412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c047-2e5d-4854-8d85-f5ef72ab51da None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:02.796412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c047-2e5d-4854-8d85-f5ef72ab51da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:02.813754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-db99c047-2e5d-4854-8d85-f5ef72ab51da None None] MFA Rules not processed for user `34e95873c90645b59bd6225c15118847`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:02.813754 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-db99c047-2e5d-4854-8d85-f5ef72ab51da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:02.869314 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1421/2811] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:02.976191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:03.005100 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:03.308785 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:03.377045 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:03.964755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.153334 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.296155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.301609 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:04.368155 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266bca-1460-4e14-bf6a-c12cf00b3f9b service glance] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:04.372992 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:04.373874 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:04.374207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:04.374960 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] PATH_INFO: `/v3/users/09f3f39bf79746f89b281ab6422c8670` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:04.376333 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f3f39bf79746f89b281ab6422c8670)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:04.378351 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:04.450562 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.611950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f3f39bf79746f89b281ab6422c8670'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:04.613184 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f3f39bf79746f89b281ab6422c8670'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:04.631289 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f3f39bf79746f89b281ab6422c8670'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:04.651036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f3f39bf79746f89b281ab6422c8670'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:04.673045 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.691033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f3f39bf79746f89b281ab6422c8670'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:04.697203 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.701075 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1391/2812] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:17:04 2022] DELETE /identity/v3/users/09f3f39bf79746f89b281ab6422c8670 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:04.705291 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:04.705692 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:04.706197 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:04.738748 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:04.740874 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:04.813320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1422/2813] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:17:04.820932 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:04.822337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:04.857808 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.886725 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0407b-c4d1-4a0a-9320-becfb819db5a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:04.890927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:04.891579 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:04.892237 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:04.892520 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:04.892796 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:04.902991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:04.904455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:04.915293 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1392/2814] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:05.181894 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=100 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:05.250170 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:05.278748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:05.320780 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:05.322222 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:05.335271 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50415340-f7f1-48fa-98e9-4b38fd804012 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:05.339999 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:05.340872 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:05.341172 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:05.341432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] PATH_INFO: `/v3/projects/49ac4327336944bdbf10d29bb6f4c424` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:05.342627 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ac4327336944bdbf10d29bb6f4c424)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:05.344719 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:05.375977 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:05.428670 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ac4327336944bdbf10d29bb6f4c424', 'request_id': 'req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.480127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ac4327336944bdbf10d29bb6f4c424', 'request_id': 'req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.487555 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ac4327336944bdbf10d29bb6f4c424', 'request_id': 'req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.502308 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] The token cache is being invalidate because project 49ac4327336944bdbf10d29bb6f4c424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:05.502601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.503293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.504830 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1423/2815] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:17:05 2022] DELETE /identity/v3/projects/49ac4327336944bdbf10d29bb6f4c424 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:05.509676 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:05.519581 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe2d8-aea9-44e5-9ec9-bbe868b69d02 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:05.577505 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:05.578389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:05.578680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:05.578961 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] PATH_INFO: `/v3/users/7f76276271c045ce93b52e1987d80d85` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:05.580187 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f76276271c045ce93b52e1987d80d85)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:05.582115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:05.674673 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:05.803217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f76276271c045ce93b52e1987d80d85'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.805177 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f76276271c045ce93b52e1987d80d85'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.828208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f76276271c045ce93b52e1987d80d85'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:05.852970 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f76276271c045ce93b52e1987d80d85'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.039049 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-3b20cc5b-e94a-4700-bf6a-4774d11a0b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f76276271c045ce93b52e1987d80d85'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.046502 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1393/2816] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:17:05 2022] DELETE /identity/v3/users/7f76276271c045ce93b52e1987d80d85 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:06.470557 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:06.472447 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:06.511415 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3caae-92e5-46ba-bb66-2f229ebfeb0a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:06.583194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:06.584793 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:06.585073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:06.585349 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] PATH_INFO: `/v3/projects/54fc7ccac78747a296d852e5a62433ad` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:06.586518 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fc7ccac78747a296d852e5a62433ad)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:06.588456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:06.701738 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fc7ccac78747a296d852e5a62433ad', 'request_id': 'req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.704320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:06.783664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fc7ccac78747a296d852e5a62433ad', 'request_id': 'req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.790249 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fc7ccac78747a296d852e5a62433ad', 'request_id': 'req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.803074 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] The token cache is being invalidate because project 54fc7ccac78747a296d852e5a62433ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:06.803364 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.804054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-1856b48a-33e4-4823-a1c5-3541fcbfe6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:06.805587 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1424/2817] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:17:06 2022] DELETE /identity/v3/projects/54fc7ccac78747a296d852e5a62433ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:06.813245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:06.813622 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:06.814007 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:06.836191 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:06.839061 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:06.882967 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:06.942268 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1394/2818] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:06.944940 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:06.945240 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:06.945538 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:06.988287 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:06.990057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:07.000530 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1425/2819] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:07.004461 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.017114 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e3ed9-e412-4658-8a5e-377508453528 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.024649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.025014 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.025380 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.025854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.026671 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:17:07.027056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.028829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.055283 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1395/2820] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:17:07.056715 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.071621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ccbc4-5734-4805-8568-39e85f7f4385 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.073927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.074601 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.074887 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.075164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.075938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.077864 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.183366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1426/2821] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:17:07 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:17:07.187432 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.198455 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ac8ff-ac09-4821-8e3e-f0695dd355d0 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.254226 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.256751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.256751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.256751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.256751 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.258930 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.333503 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1396/2822] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:17:07 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:17:07.334896 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.352065 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663db5c-8334-4948-af5b-050ad38b1467 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.356489 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.357695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.357695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.357949 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.358661 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.360300 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.372077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1427/2823] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:17:07.375914 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.386772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4092ebf-1659-444e-9a89-fa120813d643 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.391556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.392164 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.392454 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.392740 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.393467 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.395066 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb653a7-d3ad-4781-b84f-fa5dba390560 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.410986 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1397/2824] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:17:07.412093 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.423059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733160-956a-4bdc-8805-d38c58a5a215 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.428655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.429544 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.429856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.430132 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] PATH_INFO: `/v3/projects/fe1b0b08159449bb85019f6d4382abb4/users/bb0eee26715344ee8affeeb46d8c5acd/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.447389 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1b0b08159449bb85019f6d4382abb4, user_id=bb0eee26715344ee8affeeb46d8c5acd, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.452707 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.537164 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1428/2825] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:17:07 2022] PUT /identity/v3/projects/fe1b0b08159449bb85019f6d4382abb4/users/bb0eee26715344ee8affeeb46d8c5acd/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:07.547490 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.547817 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.548120 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.582162 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] MFA Rules not processed for user `bb0eee26715344ee8affeeb46d8c5acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:07.583557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:07.660964 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1398/2826] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:17:07.673729 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:07.675569 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:07.735195 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9fe48-6696-4d09-98c6-bca0bf313027 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:07.738880 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:07.740094 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:07.740387 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:07.740668 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:07.748987 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:07.750414 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24afa-9118-4c82-8433-56ce8484fe65 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:07.759087 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1429/2827] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:16.651098 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:16.684787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:16.720939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a657aa-84ac-4cb0-82ee-b2f5a6ff1b0a None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:16.735918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:16.736822 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:16.737112 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:16.737389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] PATH_INFO: `/v3/users/bb0eee26715344ee8affeeb46d8c5acd` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:16.738769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0eee26715344ee8affeeb46d8c5acd)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:16.740830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:16.888710 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0eee26715344ee8affeeb46d8c5acd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:16.889923 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0eee26715344ee8affeeb46d8c5acd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:16.898636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0eee26715344ee8affeeb46d8c5acd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:16.917902 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0eee26715344ee8affeeb46d8c5acd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:16.998884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0eee26715344ee8affeeb46d8c5acd'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.008231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1399/2828] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:17:16 2022] DELETE /identity/v3/users/bb0eee26715344ee8affeeb46d8c5acd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:17.013017 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:17.013523 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:17.013613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:17.032768 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:17.033993 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:17.098759 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1430/2829] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:17.109440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:17.110891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:17.179115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff465-bfd5-497a-8821-1865cc188358 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:17.179115 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:17.180320 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:17.180614 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:17.180898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:17.190947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:17.192391 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:17.204621 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1400/2830] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:17.652210 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:17.653733 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:17.667960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5880f97-30ab-414b-af9f-6202627f891b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:17.672734 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:17.673901 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:17.679356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:17.679356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] PATH_INFO: `/v3/projects/fe1b0b08159449bb85019f6d4382abb4` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:17.679356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1b0b08159449bb85019f6d4382abb4)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:17.679356 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:17.698888 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:17.815495 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1b0b08159449bb85019f6d4382abb4', 'request_id': 'req-2f550539-14ea-4eed-acd6-571f730985ae'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.890791 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1b0b08159449bb85019f6d4382abb4', 'request_id': 'req-2f550539-14ea-4eed-acd6-571f730985ae'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.909458 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1b0b08159449bb85019f6d4382abb4', 'request_id': 'req-2f550539-14ea-4eed-acd6-571f730985ae'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.928316 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] The token cache is being invalidate because project fe1b0b08159449bb85019f6d4382abb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:17.928612 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.929503 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2f550539-14ea-4eed-acd6-571f730985ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:17.931117 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1431/2831] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:17:17 2022] DELETE /identity/v3/projects/fe1b0b08159449bb85019f6d4382abb4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:21.361792 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:21.364828 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:21.380742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a71d4-9f4c-4686-b98f-cf2e5e7ef37c service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:21.441939 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:21.451233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:21.452157 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:21.452440 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:21.452711 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] PATH_INFO: `/v3/users/6878bc80434b494bbaeb67b9b3559abf` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:21.453900 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6878bc80434b494bbaeb67b9b3559abf)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:21.455898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:21.643316 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6878bc80434b494bbaeb67b9b3559abf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:21.644072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6878bc80434b494bbaeb67b9b3559abf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:21.651009 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6878bc80434b494bbaeb67b9b3559abf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:21.663582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6878bc80434b494bbaeb67b9b3559abf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:21.781574 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6878bc80434b494bbaeb67b9b3559abf'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:21.789471 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1401/2832] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:17:21 2022] DELETE /identity/v3/users/6878bc80434b494bbaeb67b9b3559abf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:21.793904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:21.794802 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:21.795073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:21.813799 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:21.815059 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:21.878256 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1432/2833] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:21.888286 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:21.889730 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:21.962327 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284b6a-5002-47a6-9c1f-df3f7d2680ef admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:21.966152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:21.966818 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:21.967104 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:21.967386 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:21.978345 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:21.979977 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b98e5-4449-4275-b190-61501b8d1693 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:21.991307 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1402/2834] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:22.435358 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:22.436876 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:22.450499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eac94-8660-49f4-98a7-e32975c1c501 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:22.456873 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:22.457848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:22.458660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:22.458660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] PATH_INFO: `/v3/projects/b1b5736cf6a64f0ba8fc3e5ed99ba5f3` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:22.460044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b5736cf6a64f0ba8fc3e5ed99ba5f3)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:22.462435 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:22.561840 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b5736cf6a64f0ba8fc3e5ed99ba5f3', 'request_id': 'req-3b4d418d-02de-4247-b16c-808bbc33fa89'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:22.633620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b5736cf6a64f0ba8fc3e5ed99ba5f3', 'request_id': 'req-3b4d418d-02de-4247-b16c-808bbc33fa89'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:22.640142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b5736cf6a64f0ba8fc3e5ed99ba5f3', 'request_id': 'req-3b4d418d-02de-4247-b16c-808bbc33fa89'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:22.652293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] The token cache is being invalidate because project b1b5736cf6a64f0ba8fc3e5ed99ba5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:22.652588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:22.653229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-3b4d418d-02de-4247-b16c-808bbc33fa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:22.654766 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1433/2835] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:17:22 2022] DELETE /identity/v3/projects/b1b5736cf6a64f0ba8fc3e5ed99ba5f3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:22.660396 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:22.660940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:22.661059 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:22.680544 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:22.681762 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:22.745458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1403/2836] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:22.809390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:22.809991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:22.809991 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:22.828722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:22.829934 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:22.838834 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1434/2837] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:22.842991 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:22.853207 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef123a8-51ab-4f7e-905e-998b98deca99 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:22.857750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:22.858398 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:22.858680 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:22.858952 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:22.859702 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:17:22.866868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:22.866868 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:22.872990 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1404/2838] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:17:22.877424 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:22.886950 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9f07-549f-4bbf-ad9f-904160e016b6 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:22.895419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:22.895419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:22.895419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:22.895419 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:22.895881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:22.895881 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:22.959057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:22.966798 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1435/2839] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:17:22 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 13:17:22.971062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:22.977028 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:22.982296 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b3e6-8a5e-4bcf-9ed4-13344734ca1a admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:23.041898 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:23.042610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.042940 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.043217 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.043937 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:23.045884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:23.124594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1405/2840] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:17:22 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:17:23.128914 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:23.139393 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7138d-2167-4491-bbcb-ff0784fbf1cc admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:23.143969 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:23.144620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.144902 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.145178 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.145953 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:23.149148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:23.160018 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1436/2841] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 13:17:23.164055 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:23.174335 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f578-a898-4f23-90ff-cca3ca3ab49b admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:23.179125 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:23.184557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.184557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.184557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.184557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:23.184557 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2740c-b716-4d59-b175-512336a7f108 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:23.193047 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1406/2842] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:17:23.197691 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:23.207581 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf38fc-147a-4ad4-b1af-325026f24e1a admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:23.212975 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:23.213849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.214129 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.214404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] PATH_INFO: `/v3/projects/4a19ebb884084e97a6a035e1d8ef17e4/users/09ff5b3a4e564f31ac0dbbf0be6e7ba7/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.228957 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a19ebb884084e97a6a035e1d8ef17e4, user_id=09ff5b3a4e564f31ac0dbbf0be6e7ba7, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:23.231577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:23.326281 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1437/2843] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:17:23 2022] PUT /identity/v3/projects/4a19ebb884084e97a6a035e1d8ef17e4/users/09ff5b3a4e564f31ac0dbbf0be6e7ba7/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:23.337321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dc7-bab2-42d2-832c-31d5a0759734 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.337619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dc7-bab2-42d2-832c-31d5a0759734 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.337936 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dc7-bab2-42d2-832c-31d5a0759734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.365134 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-0ff60dc7-bab2-42d2-832c-31d5a0759734 None None] MFA Rules not processed for user `09ff5b3a4e564f31ac0dbbf0be6e7ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:23.367077 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-0ff60dc7-bab2-42d2-832c-31d5a0759734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:23.434423 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1407/2844] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:23.454372 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:23.457819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:23.523613 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7889ad-48cd-415b-8036-ea6f597cf0a6 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:23.528805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:23.529722 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:23.530054 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:23.530395 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:23.542751 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:23.544404 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:23.556886 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1438/2845] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:24.619684 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5903d-22fb-4530-9545-11697d455124 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:24.620377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5903d-22fb-4530-9545-11697d455124 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:24.620377 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5903d-22fb-4530-9545-11697d455124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:24.637807 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-99e5903d-22fb-4530-9545-11697d455124 None None] MFA Rules not processed for user `34e95873c90645b59bd6225c15118847`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:24.642678 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-99e5903d-22fb-4530-9545-11697d455124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:24.693810 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1408/2846] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 13:17:26.605377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:26.670048 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28eb0-10b9-4cfc-b2de-915795fbf6e8 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:26.674947 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:26.675904 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:26.676221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:26.676500 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] PATH_INFO: `/v3/users/09ff5b3a4e564f31ac0dbbf0be6e7ba7` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:26.677773 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ff5b3a4e564f31ac0dbbf0be6e7ba7)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:26.679897 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:26.922639 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ff5b3a4e564f31ac0dbbf0be6e7ba7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:26.923383 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ff5b3a4e564f31ac0dbbf0be6e7ba7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:26.986819 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ff5b3a4e564f31ac0dbbf0be6e7ba7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:26.999655 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:27.001905 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ff5b3a4e564f31ac0dbbf0be6e7ba7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:27.008892 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ff5b3a4e564f31ac0dbbf0be6e7ba7'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:27.014764 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1439/2847] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:17:26 2022] DELETE /identity/v3/users/09ff5b3a4e564f31ac0dbbf0be6e7ba7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:27.019419 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:27.019984 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:27.020152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:27.037375 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:27.038686 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:27.048201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:27.098915 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1409/2848] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:27.108961 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:27.111228 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:27.174509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ef43-df84-4e14-ba18-0a90cac6560b admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:27.178182 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:27.178829 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:27.179142 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:27.179425 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:27.191047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:27.192563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:27.203912 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1440/2849] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:17:27.793755 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:27.795328 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:27.808804 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b20bcf-f359-4da7-abcd-09042fb59b1d None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:27.813556 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:27.814514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:27.814873 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:27.815224 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] PATH_INFO: `/v3/projects/4a19ebb884084e97a6a035e1d8ef17e4` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:27.816576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a19ebb884084e97a6a035e1d8ef17e4)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:27.818563 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:27.934085 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a19ebb884084e97a6a035e1d8ef17e4', 'request_id': 'req-9661e8df-d95b-4acb-9439-6cdfd31390aa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:27.940329 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a19ebb884084e97a6a035e1d8ef17e4', 'request_id': 'req-9661e8df-d95b-4acb-9439-6cdfd31390aa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:28.004577 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a19ebb884084e97a6a035e1d8ef17e4', 'request_id': 'req-9661e8df-d95b-4acb-9439-6cdfd31390aa'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:28.016741 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] The token cache is being invalidate because project 4a19ebb884084e97a6a035e1d8ef17e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:17:28.017349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:28.018010 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-9661e8df-d95b-4acb-9439-6cdfd31390aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:17:28.019643 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1410/2850] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:17:27 2022] DELETE /identity/v3/projects/4a19ebb884084e97a6a035e1d8ef17e4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:17:34.652708 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:34.654289 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:34.666416 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6a07-d081-44d7-a60e-a3c34c7a9862 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:34.716699 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:34.717347 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:34.717634 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:34.717913 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:34.719717 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:34.782373 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:34.783762 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:34.794658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1441/2851] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:17:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:17:38.013439 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:44.788938 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:DELETE=1,keystone:SELECT=82 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:46.581919 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5fb3-ae3d-4dba-8cba-5cdf9a42eaec None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:46.582407 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5fb3-ae3d-4dba-8cba-5cdf9a42eaec None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:46.582514 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce5fb3-ae3d-4dba-8cba-5cdf9a42eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:46.600863 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-9fce5fb3-ae3d-4dba-8cba-5cdf9a42eaec None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:17:46.602072 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-9fce5fb3-ae3d-4dba-8cba-5cdf9a42eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:46.656797 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1411/2852] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 6 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:17:46.790971 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:17:46.792678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:17:46.860974 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98104135-6ac3-47ec-a866-4f6c23fe17db service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:17:46.866221 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:17:46.866883 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:17:46.867201 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:17:46.867486 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:17:46.876918 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:17:46.878513 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:17:46.887577 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1442/2853] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:17:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:17:56.650054 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=25 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:56.883376 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=32 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:03.368560 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:03.369037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:03.369146 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:03.387179 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] MFA Rules not processed for user `c94073eaf78b44c0b50eb85460904ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:03.388406 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:03.395446 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1412/2854] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 6 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:03.408398 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:03.419167 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690f75-7589-448c-be49-896d74fabdf2 service swift] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:03.424399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ec321b639b467595aa54be55e84956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:03.425047 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:03.425336 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:03.425616 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:03.433824 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:03.435403 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:03.443665 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1443/2855] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 6 13:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 13:18:06.311677 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:06.313221 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:06.382240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5a35-b3a2-4dee-bcfa-a9e3fa80c68c None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:06.387341 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:06.388240 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:06.388527 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:06.388802 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] PATH_INFO: `/v3/users/34e95873c90645b59bd6225c15118847` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:06.389980 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e95873c90645b59bd6225c15118847)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:06.391989 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:06.538546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e95873c90645b59bd6225c15118847'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:06.539117 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e95873c90645b59bd6225c15118847'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:06.546415 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e95873c90645b59bd6225c15118847'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:06.558819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e95873c90645b59bd6225c15118847'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:06.609507 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a1fe88c4-4d33-46fa-b16e-722fb92c8112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e95873c90645b59bd6225c15118847'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:06.615733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1413/2856] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:18:06 2022] DELETE /identity/v3/users/34e95873c90645b59bd6225c15118847 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 13:18:06.845498 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:06.858057 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e3cad-f4ca-4b2b-a101-65fbba7f9305 service swift] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:06.917867 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:06.918736 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:06.919024 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:06.919299 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] PATH_INFO: `/v3/projects/2dbb7192ee02406a959af9cc4c2577a2` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:06.920563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dbb7192ee02406a959af9cc4c2577a2)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:06.922606 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.021787 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dbb7192ee02406a959af9cc4c2577a2', 'request_id': 'req-ab66d96f-4d76-4138-8c30-8193ace0e7ab'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:07.084394 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dbb7192ee02406a959af9cc4c2577a2', 'request_id': 'req-ab66d96f-4d76-4138-8c30-8193ace0e7ab'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:07.090384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dbb7192ee02406a959af9cc4c2577a2', 'request_id': 'req-ab66d96f-4d76-4138-8c30-8193ace0e7ab'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:07.101194 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] The token cache is being invalidate because project 2dbb7192ee02406a959af9cc4c2577a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:18:07.101481 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:07.102113 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ab66d96f-4d76-4138-8c30-8193ace0e7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:07.103660 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1444/2857] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:18:06 2022] DELETE /identity/v3/projects/2dbb7192ee02406a959af9cc4c2577a2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:18:07.108578 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.108871 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.109149 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.127641 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:07.128949 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:07.187783 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1414/2858] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:07.195323 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.197384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.197384 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.214564 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:07.215821 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:07.223712 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1445/2859] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:07.227772 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.238122 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a140b-fde1-457d-89f6-8399bc4f64c3 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.242669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.243317 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.243639 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.243918 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.245347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80341) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 13:18:07.245658 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.247239 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.255666 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:07.258869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1415/2860] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 6 13:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 13:18:07.263274 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.272637 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50a76-5225-4d7c-9df2-ce0ba5acdc11 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.277763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.278405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.278695 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.278979 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.279714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.281623 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.361594 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1446/2861] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 6 13:18:07 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:18:07.365479 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.381408 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee273610-c3a4-4bc9-8c97-02e63f5763b3 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.439363 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.440060 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.440350 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.440629 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] PATH_INFO: `/v3/users` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.441324 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.443235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.512404 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1416/2862] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 6 13:18:07 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 13:18:07.516533 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.528212 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d591b-7550-4945-99a6-1486f33e8a15 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.532996 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.533664 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.533960 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.534261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.534968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.536640 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.547998 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1447/2863] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:18:07.552142 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.562219 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad187-ee0f-43b5-b5c7-6f590e08ffeb admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.566769 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.567420 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.567735 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.568016 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.568733 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.570313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db0268-8de2-4763-be57-6e4f9c166487 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.580119 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1417/2864] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 6 13:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 13:18:07.583956 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.594690 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970ad-60ce-46cd-b058-2b6377ebb7ed admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.599338 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.600246 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.600535 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.600823 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] PATH_INFO: `/v3/projects/3f21e6391eb645f08f5ebd8fa6faf36d/users/ba5954af10bf4511bf0ea47df12b4d3a/roles/79fc4f0825474a51ad5377681ccd06cf` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.615218 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f21e6391eb645f08f5ebd8fa6faf36d, user_id=ba5954af10bf4511bf0ea47df12b4d3a, role_id=79fc4f0825474a51ad5377681ccd06cf)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.617836 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.689679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1448/2865] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 6 13:18:07 2022] PUT /identity/v3/projects/3f21e6391eb645f08f5ebd8fa6faf36d/users/ba5954af10bf4511bf0ea47df12b4d3a/roles/79fc4f0825474a51ad5377681ccd06cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:18:07.701245 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.701547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.701829 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.728181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] MFA Rules not processed for user `ba5954af10bf4511bf0ea47df12b4d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:07.729620 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:07.792994 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1418/2866] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:07.803770 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:07.805470 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:07.820551 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:07.864399 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b10c-c410-46fa-b024-b95728320b20 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:07.868141 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:07.868721 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:07.869006 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:07.869286 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:07.879296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:07.880763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0d8ff-32e3-4fd8-bc80-73cfb34b12da service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:07.890714 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1449/2867] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:18:17.789995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:17.886159 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=20 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:26.822512 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:26.886070 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece303dd-4ba8-46ee-82df-b2e3e0d57963 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:26.891102 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:26.892081 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:26.892369 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:26.892649 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] PATH_INFO: `/v3/users/ba5954af10bf4511bf0ea47df12b4d3a` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:26.893834 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5954af10bf4511bf0ea47df12b4d3a)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:26.895815 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:27.068583 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5954af10bf4511bf0ea47df12b4d3a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.069183 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5954af10bf4511bf0ea47df12b4d3a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.076773 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5954af10bf4511bf0ea47df12b4d3a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.088705 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5954af10bf4511bf0ea47df12b4d3a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.152151 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5954af10bf4511bf0ea47df12b4d3a'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.158852 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1419/2868] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:18:26 2022] DELETE /identity/v3/users/ba5954af10bf4511bf0ea47df12b4d3a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:18:27.163635 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:27.164146 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:27.164288 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:27.183611 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] MFA Rules not processed for user `1492cd2eb7c64ad8959375e22df26ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:27.185192 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:27.243591 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1450/2869] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:27.253382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:27.254763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:27.312181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a494e-0b81-43f0-8de6-a5cfb004a0ec admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:27.315830 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:27.316469 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:27.316754 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:27.317036 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:27.326922 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:27.328319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522d310-5001-4b6f-89c3-fde32e4d3552 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:27.337660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1420/2870] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:18:27.720605 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:27.722034 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:27.736602 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cebd-66a1-474d-84d1-ef2916e136a0 None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:27.741373 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:27.745107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:27.745107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:27.745107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] PATH_INFO: `/v3/projects/3f21e6391eb645f08f5ebd8fa6faf36d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:27.745107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f21e6391eb645f08f5ebd8fa6faf36d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:27.746127 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:27.873679 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f21e6391eb645f08f5ebd8fa6faf36d', 'request_id': 'req-7c4115a9-83e9-4911-8e24-4a835fa5732d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.952239 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f21e6391eb645f08f5ebd8fa6faf36d', 'request_id': 'req-7c4115a9-83e9-4911-8e24-4a835fa5732d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.958380 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f21e6391eb645f08f5ebd8fa6faf36d', 'request_id': 'req-7c4115a9-83e9-4911-8e24-4a835fa5732d'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.970898 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] The token cache is being invalidate because project 3f21e6391eb645f08f5ebd8fa6faf36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:18:27.971193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.971835 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:18:27.973499 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1451/2871] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:18:27 2022] DELETE /identity/v3/projects/3f21e6391eb645f08f5ebd8fa6faf36d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:18:37.333592 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:37.967848 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:55.591482 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:55.592033 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:55.592143 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:55.610750 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] MFA Rules not processed for user `bd78c278513540ecadfc1a0f90b9ab16`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:18:55.611996 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:55.665709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1421/2872] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 6 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:18:55.703405 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:55.705021 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:55.761919 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4115a9-83e9-4911-8e24-4a835fa5732d admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:55.766173 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8839b9c0fca4cffb2bae93393cb7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:55.766822 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:55.767109 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:55.767390 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:55.769382 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:55.841828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:55.843456 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:55.855279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1452/2873] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:18:56.141186 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:56.142582 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:56.200457 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38a6e-4e81-41c9-8c52-fdc1653f0484 None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:56.205152 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:56.205794 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:56.206083 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:56.206364 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:56.208202 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:56.218100 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:56.219709 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:56.227851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1422/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:18:56.927335 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:56.928890 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:56.936062 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:56.945431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7273a-f46e-4b25-a739-91a9e85847e2 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:56.949211 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:56.949859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:56.950148 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:56.950426 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:56.952854 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:56.968297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:56.973995 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:56.981920 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1423/2875] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:18:56.989763 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:56.998319 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681582b5-02ef-4726-b04c-c078bd484b7b service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:57.002389 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:57.003063 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:57.003347 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:57.003659 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:57.005465 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01afb-3178-420c-a745-004b8021c415 service cinder] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:57.005593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:57.010849 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:57.011628 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:57.012040 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:57.012417 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:57.014669 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:57.017547 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:57.018997 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:57.026508 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:57.028140 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:57.028297 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1424/2876] 10.222.0.13 () {60 vars in 1396 bytes} [Mon Jun 6 13:18:56 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:18:57.040309 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1453/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:18:59.722068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:18:59.723667 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:59.734993 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbecf-a520-4c6a-a847-42d53d79855c service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:18:59.738594 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:18:59.739233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:18:59.739546 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:18:59.739869 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:18:59.741591 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:18:59.751139 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:18:59.752688 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:18:59.768199 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1425/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:19:07.035202 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=86 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:09.757431 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=69 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:10.163790 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:19:10.165252 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:19:10.180726 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf6fe-b1d7-4d78-aa07-d6140a9bbe42 service placement] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:19:10.186279 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:19:10.186939 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:10.187206 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:10.188782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:10.189302 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:19:10.201731 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:19:10.203293 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af131e-b675-4895-8144-5149e44f5cec service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:19:10.213855 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1454/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:19:14.403037 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:19:14.416606 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f040f-1499-451b-a71a-d9e5ed0c4883 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:19:14.422605 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:19:14.423422 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:14.423745 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:14.424024 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:14.426218 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:19:14.439378 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:19:14.441004 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca350-526e-4d55-8e31-21c3c054e760 service nova] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:19:14.452665 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1426/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:19:20.209429 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=6 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:24.447254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=6 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:52.228101 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c944b-9a0e-41a2-a500-0efade65ef8b None None] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:52.228750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c944b-9a0e-41a2-a500-0efade65ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:52.228750 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c944b-9a0e-41a2-a500-0efade65ef8b None None] PATH_INFO: `/` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:52.230089 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1455/2881] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:19:52.236484 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e74c-f910-456a-9c73-9a3bb574033c None None] REQUEST_METHOD: `POST` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:52.237233 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e74c-f910-456a-9c73-9a3bb574033c None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:52.237611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e74c-f910-456a-9c73-9a3bb574033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:52.277738 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.auth.core [None req-d292e74c-f910-456a-9c73-9a3bb574033c None None] MFA Rules not processed for user `a9a0512f3f084ca791825b70b0d1c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80341) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:19:52.279787 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-d292e74c-f910-456a-9c73-9a3bb574033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:19:52.291619 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1427/2882] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:19:52.298730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c944b-9a0e-41a2-a500-0efade65ef8b None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:19:52.310044 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c944b-9a0e-41a2-a500-0efade65ef8b None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:19:52.313725 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:19:52.314366 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:52.314678 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:52.314959 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:52.322272 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:19:52.323723 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40f330-c2a8-43b5-a6bf-e17c90ec6b7b service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:19:52.332232 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1456/2883] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:19:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:19:53.425637 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3da07-6cdd-465a-a0e7-54cb6eeb00df None None] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:53.426458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3da07-6cdd-465a-a0e7-54cb6eeb00df None None] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:53.426458 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3da07-6cdd-465a-a0e7-54cb6eeb00df None None] PATH_INFO: `/` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:53.427853 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1428/2884] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 6 13:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 13:19:53.433320 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] REQUEST_METHOD: `POST` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:53.433778 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:53.434039 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:53.452363 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.auth.core [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] MFA Rules not processed for user `966c3cbce1b443fd9aae9c03cbe6a406`. Rule list: `[]` (Enabled: `True`). {{(pid=80340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 13:19:53.453563 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:19:53.463698 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1457/2885] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 6 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 13:19:53.474934 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3da07-6cdd-465a-a0e7-54cb6eeb00df None None] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:19:53.486925 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3da07-6cdd-465a-a0e7-54cb6eeb00df None None] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:19:53.490497 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:19:53.491141 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:19:53.491428 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:19:53.491748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:19:53.502168 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:19:53.503630 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:19:53.515023 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1429/2886] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:20:03.447019 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=9 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:03.509576 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=15 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:44.803090 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:20:44.844812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fa26c-889b-42d2-a009-2f860ea865fa None None] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:20:44.850238 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '966c3cbce1b443fd9aae9c03cbe6a406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:20:44.850856 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:20:44.851137 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:20:44.851505 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:20:44.853193 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:20:44.886362 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:20:44.888027 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:20:44.899672 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1458/2887] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:20:54.894966 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=28 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:55.944618 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:20:55.973757 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdee68-0083-4d50-9dfc-6064161d6837 service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:20:55.977746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:20:55.978384 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:20:55.978669 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:20:55.978947 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:20:55.980878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:20:56.066764 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:20:56.068235 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:20:56.086835 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1430/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:20:59.530154 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:20:59.531621 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:20:59.545932 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050da2-97d5-473d-95a8-8e8cc8bb4a74 service nova] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:20:59.551412 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:20:59.552097 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:20:59.552377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:20:59.552648 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:20:59.554463 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:20:59.566482 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:20:59.568108 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:20:59.579078 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1459/2889] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:20:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:21:03.168612 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:03.181294 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efeba-97a9-4bbe-9509-f759e6fabdfc service neutron] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:03.186313 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:03.186956 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:03.187241 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:03.187564 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:03.189481 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:03.201382 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:03.202959 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:03.214337 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1431/2890] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:21:03.282614 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:03.284073 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:03.298296 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e24da-3043-45c3-8ed5-4e06130f8fe2 service placement] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:03.303261 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:03.304188 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:03.304477 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:03.304763 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] PATH_INFO: `/v3/users/bd78c278513540ecadfc1a0f90b9ab16` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:03.305951 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd78c278513540ecadfc1a0f90b9ab16)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:03.307922 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:03.489148 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd78c278513540ecadfc1a0f90b9ab16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:03.489782 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd78c278513540ecadfc1a0f90b9ab16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:03.606976 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd78c278513540ecadfc1a0f90b9ab16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:03.619804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd78c278513540ecadfc1a0f90b9ab16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:03.627472 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd78c278513540ecadfc1a0f90b9ab16'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:03.633685 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1460/2891] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:21:03 2022] DELETE /identity/v3/users/bd78c278513540ecadfc1a0f90b9ab16 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:03.896040 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:03.909610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bf51-bc4e-42dd-95be-556c8456b924 service placement] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:03.971593 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:03.972476 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:03.972756 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:03.973053 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] PATH_INFO: `/v3/projects/332996ee21f54ef3b78907332f5decce` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:03.974254 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332996ee21f54ef3b78907332f5decce)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:03.976181 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:04.055354 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:04.064831 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332996ee21f54ef3b78907332f5decce', 'request_id': 'req-644cfb57-4d26-4042-9d9f-7e14a0684143'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.070842 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332996ee21f54ef3b78907332f5decce', 'request_id': 'req-644cfb57-4d26-4042-9d9f-7e14a0684143'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.103723 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332996ee21f54ef3b78907332f5decce', 'request_id': 'req-644cfb57-4d26-4042-9d9f-7e14a0684143'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.114860 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] The token cache is being invalidate because project 332996ee21f54ef3b78907332f5decce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:21:04.115154 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.115859 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.121610 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1432/2892] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:21:03 2022] DELETE /identity/v3/projects/332996ee21f54ef3b78907332f5decce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:04.121730 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:04.123004 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:04.136681 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baec81-4fad-4269-866e-84905abc1009 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:04.193455 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:04.194329 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:04.194617 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:04.194899 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] PATH_INFO: `/v3/users/a8f6ee8e992c4fa6baaeb63144e791e0` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:04.196121 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f6ee8e992c4fa6baaeb63144e791e0)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:04.198041 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:04.352032 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f6ee8e992c4fa6baaeb63144e791e0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.352666 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f6ee8e992c4fa6baaeb63144e791e0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.418043 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f6ee8e992c4fa6baaeb63144e791e0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.424509 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:04.431948 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f6ee8e992c4fa6baaeb63144e791e0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.438777 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f6ee8e992c4fa6baaeb63144e791e0'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.444804 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1461/2893] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:21:04 2022] DELETE /identity/v3/users/a8f6ee8e992c4fa6baaeb63144e791e0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:04.694623 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:04.696201 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:04.711126 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cfb57-4d26-4042-9d9f-7e14a0684143 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:04.774746 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:04.775646 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:04.775931 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:04.776208 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] PATH_INFO: `/v3/projects/ca11d0c8e89d4a09815d0682892d4865` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:04.777451 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca11d0c8e89d4a09815d0682892d4865)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:04.779360 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:04.875704 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca11d0c8e89d4a09815d0682892d4865', 'request_id': 'req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.881819 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca11d0c8e89d4a09815d0682892d4865', 'request_id': 'req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.939501 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca11d0c8e89d4a09815d0682892d4865', 'request_id': 'req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.950660 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] The token cache is being invalidate because project ca11d0c8e89d4a09815d0682892d4865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80341) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:21:04.950951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.951611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:04.953470 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1433/2894] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:21:04 2022] DELETE /identity/v3/projects/ca11d0c8e89d4a09815d0682892d4865 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:14.573077 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:14.947405 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:34.695645 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:34.697143 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:34.766295 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5af99-e368-415c-8ec6-7f7edac3a43f admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:34.813290 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9a0512f3f084ca791825b70b0d1c6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:34.813931 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:34.814213 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:34.814487 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:34.816235 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:34.876955 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:34.878371 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:34.887746 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1462/2895] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 13:21:35.909983 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:35.911748 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:35.925132 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a66532-7ecf-4c66-9d8a-1173ea4262ae admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:35.930084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:35.930950 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:35.931231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:35.931553 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] PATH_INFO: `/v3/users/eaa2b82129ac4f8796fdd57cad8e0bfb` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:35.932742 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa2b82129ac4f8796fdd57cad8e0bfb)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:35.934685 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:36.123034 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa2b82129ac4f8796fdd57cad8e0bfb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.123663 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa2b82129ac4f8796fdd57cad8e0bfb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.131144 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa2b82129ac4f8796fdd57cad8e0bfb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.143595 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa2b82129ac4f8796fdd57cad8e0bfb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.194998 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa2b82129ac4f8796fdd57cad8e0bfb'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.201321 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1434/2896] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:21:35 2022] DELETE /identity/v3/users/eaa2b82129ac4f8796fdd57cad8e0bfb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:36.430656 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:36.441340 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce0346-e142-486e-bb32-f0d2cfc9aa80 service neutron] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:36.494785 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=100 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:36.502360 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:36.503229 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:36.503519 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:36.503828 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] PATH_INFO: `/v3/projects/5a011dc568b04d8a91935a613d951b1c` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:36.505015 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a011dc568b04d8a91935a613d951b1c)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:36.506958 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:36.641658 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a011dc568b04d8a91935a613d951b1c', 'request_id': 'req-b502ac19-4d2a-41e8-884b-2ca95af139d9'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.714964 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a011dc568b04d8a91935a613d951b1c', 'request_id': 'req-b502ac19-4d2a-41e8-884b-2ca95af139d9'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.721539 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a011dc568b04d8a91935a613d951b1c', 'request_id': 'req-b502ac19-4d2a-41e8-884b-2ca95af139d9'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.734130 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] The token cache is being invalidate because project 5a011dc568b04d8a91935a613d951b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:21:36.734421 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.735107 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.736962 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1463/2897] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:21:36 2022] DELETE /identity/v3/projects/5a011dc568b04d8a91935a613d951b1c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:36.740884 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:36.742349 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:36.756099 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f32e4-9b3a-4e94-a7d9-8b49c5d058c2 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:36.813190 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:36.814231 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:36.814522 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:36.814801 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] PATH_INFO: `/v3/users/857a065a54184e0790855e9c2b19d04d` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:36.816031 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857a065a54184e0790855e9c2b19d04d)` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:36.817951 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:36.980397 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857a065a54184e0790855e9c2b19d04d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.981026 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857a065a54184e0790855e9c2b19d04d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:36.988508 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857a065a54184e0790855e9c2b19d04d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.001185 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857a065a54184e0790855e9c2b19d04d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.002840 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:37.080878 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.notifications [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857a065a54184e0790855e9c2b19d04d'} {{(pid=80341) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.087056 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1435/2898] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 6 13:21:36 2022] DELETE /identity/v3/users/857a065a54184e0790855e9c2b19d04d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:37.345391 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:37.346805 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:37.359377 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502ac19-4d2a-41e8-884b-2ca95af139d9 admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:37.417283 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1492cd2eb7c64ad8959375e22df26ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16ba10bd5fa94006bd8ba1520b916555', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:37.418149 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:37.418432 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:37.418710 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] PATH_INFO: `/v3/projects/bddcefb46ba7486c9894d1a16156b69d` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:37.419920 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddcefb46ba7486c9894d1a16156b69d)` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:37.421826 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:37.513946 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddcefb46ba7486c9894d1a16156b69d', 'request_id': 'req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.577491 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddcefb46ba7486c9894d1a16156b69d', 'request_id': 'req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.583464 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddcefb46ba7486c9894d1a16156b69d', 'request_id': 'req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e'} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.595255 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] The token cache is being invalidate because project bddcefb46ba7486c9894d1a16156b69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 13:21:37.595483 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.596144 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.notifications [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 13:21:37.597812 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1464/2899] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 6 13:21:37 2022] DELETE /identity/v3/projects/bddcefb46ba7486c9894d1a16156b69d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 13:21:40.899084 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Authenticating user token {{(pid=80341) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:21:40.900586 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:40.992611 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae709-d468-4398-afd4-9d30ab45f920 admin admin] Validating token access rules against request {{(pid=80341) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:21:41.052636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80341) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:21:41.053285 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] REQUEST_METHOD: `GET` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:21:41.053573 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] SCRIPT_NAME: `/identity` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:21:41.053851 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80341) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:21:41.055675 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.fernet_utils [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80341) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:21:41.067465 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:21:41.069068 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cff4a-111c-402a-a3d9-32e02292cbff service placement] RBAC: Authorization granted {{(pid=80341) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:21:41.079891 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: [pid: 80341|app: 0|req: 1436/2900] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:21:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 13:21:47.591620 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG dbcounter [-] [80340] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:51.074636 dv-cinder-755101-10-iscsi devstack@keystone.service[80341]: DEBUG dbcounter [-] [80341] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=69 {{(pid=80341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:26:47.864968 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Authenticating user token {{(pid=80340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 13:26:47.866702 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.fernet_utils [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 13:26:47.881813 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd233f-fc24-4b4a-9b07-eb5a656a4e1e admin admin] Validating token access rules against request {{(pid=80340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 13:26:47.886927 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e9e09994be6462ca1d4f6be27d7a604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3788f0ec7979494ea76673bf87d29e32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 13:26:47.887629 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] REQUEST_METHOD: `GET` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 13:26:47.887924 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 13:26:47.888207 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 13:26:47.897967 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 13:26:47.899588 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cde16-e791-46e4-a570-ea4d0ff245e2 service placement] RBAC: Authorization granted {{(pid=80340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 13:26:47.913200 dv-cinder-755101-10-iscsi devstack@keystone.service[80340]: [pid: 80340|app: 0|req: 1465/2901] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 6 13:26:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)